you've already answered your question. Always taper, and under a psychiatrist's care.
You are a brave person getting off your mood stabilizer. I would certainly let my p-doc know what is going on so he can monitor you. I would keep some of the mood stabilizers around in case you start going into an episode.
...yes, and also, you can visit the Bipolar Community Forum (also on MedWell) and share your experiences with the posters there also.
I'm so glad you're on the mend.