Seroxat dependancy

Hi. I have been taking Seroxat 20mg for my anxiety attacks for the past 2 years. I used to take 10mg daily after my breakfast. I am much better now because I learned how to control my thoughts and feelings and prevent attacks. My psychiatrist who put me on Seroxat told me to stop it and see for myself if i am okay without it. He told me it does nothing but give u a little confidence, some small push, and the dose is really small, so I can stop it whichever way i please. I started taking it day yes day no and i was fine. so i increased the number of days where i dont take it. Now, as i compare myself to how i was when i was on it, i feel less capable of controling my fears, yet still in control, just a bit weaker. Have I grown a dependency to Seroxat and the Seratonin levels it produces in my brain? Should I consider it a permanent drug like the diabetis, one i have to take for the rest of my life to be more in control?