You should probably get it checked out by a dentist. I was initially thinking they may be canker sores but usually canker sores don't re-pop up constantly like that. It may be canker sores but they're just triggered by something such as stress, allergy, etc and making it worse. Still, it would be best to get it checked out for peace of mind.