Mouth pains

Quick background: about a month ago I had all four wisdom teeth removed. However, since I shortly had to return to school, I was unable to get a 2 week check up.

Now, for the past 2 or 3 days I've been having a few mouth pains. It started with a sore throat. Then my tongue started to feel a little sore at the base. Within the past day my gums have started hurting (especially around the areas where my two bottom wisdom teeth used to be). I noticed today that I had one or two little bumps on my gum that have become rather painful (not severely, but enough to make me say ouch). I'm planning on making an appointment to see a dentist this week, but until then is there anything I can do to relieve the pain?Has anyone had this problem before?