Yeah, I think that would scare me a bit too. See the doctor. Sooner rather than later.
Any time you have an unprotected sexual encounter, you then have the possibility of developing some kind of infection. In your case, it could be an unrelated irritation ... or due because of the oral sex. Don't ignore it away ... it's best to have your doctor take a look and perhaps take a swab of your throat in order to culture/test it. It's always best to err on the side of caution! Take care ....
Could be irritation, could be an infection. Could be related, could be unrelated. Go see a doctor to make sure.
What are the bumps like?