Wondering about all these meds....

I am so upset about my doc forcing me to try and change a medication that is working so well for me.  I have tried so many different drugs its pathetic.  Effexor, lexapro, klonapin, anti-depressants like paxil, zoloft, celexa you name it I have tried it.  Problem is I am not depressed AT ALL...and my doc keeps telling me I have to be to be getting these anxiety or panic attacks, I don't think he is right at all.  My husband is begining to think I have lost my mind with all the changes in my moods and side effects to all these different meds.  At first he said no way to the xanax because he knew to many people that were on it and abusing it so badly, but has come around to understand that it is the only drug I have taken that gives me ZERO side effects and I have never increased my dosage but have asked to have it lowered and was advised against it by two other docs.  I now just take it as needed and for sleep at night a few nights a week if I am having trouble.  This has worked wonders for me.  Now doc convinced me two days ago to try a drug called seroquel 100mg.  I took 25mg at 11pm and did not wake till 5pm the next day.  I could not talk, walk and I was hallucinating which caused me to have a severe panic attack.  Now he wants me to try Buspar but with this drug I would need another to help me sleep so two pills instead of just the one.  I am so mad and angry I am a strong willed person and can take control of many things with myself, and I would strongly admit if I thought for one sec I was some kind of addict, but I am not.  The only thing I seemed to be addicted to is smoking, but have quit 14 times (with every pregnancy I have had with no problems because of sheer will power).  I have three small children and I can not afford to take drugs that alter my moods or debilatate me in physical ways.  Xanax does not make me sleepy and takes care of my attacks within 10 to 15 minutes after I take it.  On rare occasions I have had it not work and had been rushed to the hospital 4x for it in the last 2 years.  Some days are better than others and I take it according to each day not on a doctors prescribed schedule.  I also read alot about the life span of one pill of xanax but I have to disagree because I can still feel its effects well after 4 hrs, sometimes up to 8 hrs after.  Lesson here is everyone's body is different in how they respond to drugs of these kinds and how their bodies digest and everything so it should be on an individual basis and the doctor should not generalize you with the general population of people who abuse these drugs because they like the high from them.  That is my vent for the day!