I cannot give you a clinical diagnosis over the internet unfortunately as this site is purely educational
It is true that Lyme is difficult to diagnose and lab tests are unreliable. The best way to diagnose it is through a clinical diagnosis based on your history and symptoms, which I do not have to the fullest extent.
I am not even sure that you have a primary neurological problem - hyperactive reflexes without clonus or an upgoing toe (babinski sign) are quite common in normal young people, and your only other neurological symptom is memory loss.
You probably need to see a good general diagnositician (?internal medicine, infectious disease) to make an overall diagnosis - sometimes going to multiple 'specialists' can be counterproductive unless you have aclear idea which body system is the cause. If you are in Maryland, a senior physcician at Johns Hopkins Hospital may be your best bet at a diagnosis.
Good luck
Dr. Burrascano (the Lyme King) has published info on this.