Dizziness and allergies?

Since the beginning of the allergy season this year, about 2 months ago, i have been suffering on and off from dizziness.  at one point it was so severe i ended up in the ER.  they said it was fluid behind my ears, but when i followed up with my ENT he said there was nothing there.  They say it is from having a deviated septum on both sides and constant sinus pressure.  but it is an awful feeling.  i feel like the room is swaying, or i am, and i can't make any sudden movements.  it's causing extreme fatigue and sometimes a feeling like i will pass out,  i have never passed out though.  i feel horrible because ever since this started happening i have not been able to play with my son really b/c every time i try to do something i get dizzy too quickly.  i have had an MRI that was normal, and labs done that were essentially normal as well.  i am worried that there is something going on that no one is catching.  i also had a hearing test that was normal.  i did see a neurologist one time and she did not seem concerned with this.  said it was common in migraine suffers, but i don't have a migraine all the time!  i am also getting very shaky feeling from it too.  i have been trying claritin and benadryl as well as nasonex and astepro.  anyone have any suggestions or help?????