I have it too, but never really cared enough to try to do anything about it. Truth is I don't think there is much that can be done, other than stay away from particular foods that can iritate you.
For me, Walnuts, Egg plant, and too much citric acid gets me going.
I was prescribed Carafate to swish the mouth with, also a warm water and salt rinse.It helped me, but nothing will get rid of it permanately that I have heard of.