have you got a wisdom tooth coming through as they cann be very painful at times
dont think it will be an abcess if you look after your teeth but it wont cost you anything for a dentist to have a look just in case it gets any worse
I am a dental technician, not a dentist so I can't obviously diagnose anything. I'm not trained to. You should keep an eye on this though, but it could be a something like a Tori (pronounced tore-eye). Look it up online to see if this resembles what you are talking about. I have these myself, and have had them removed once in my life. They grow back though!
You should still consult a dentist to make sure some other condition may be present. Tori aren't dangerous, just uncomfortable and bothersome.