Could be many things, The balance organs are the semicircular canals, Eye's, Muscles, and Joints. Any one of these can send wrong signals and get you really screwed up. My situation "did not"include dizzy feelings, though they have started and happen more often. Sounds like you though that does not mean you have the same thing. Either way I believe I know how you feel by how you describe this.
Any other symptoms? I thought it strange but at the same time I thought everyone could hear their eye balls move back and forth, then I found out they can't, It's a symptom of semicircular canal dehiscence. So I ask again, any symptoms that you have that may/maynot be related?
Sounds like it could be Labyrinthitis. I would recommend consulting an ENT Specialist to have this ruled out. You can also ask your physician for a prescription for Betahistine/Antivert and see if that helps. Make sure the ENT Specialist is competent for treating and diagnosing inner ear disorders as all of them ARE NOT.