I would also like to add that these bumps or irritations are not secreting any form of liquid that I can tell..
It sounds like your Bartholin's glands are backed up. This is okay unless they are infected, in which case there is more painful inflammation, heat, fever. Also it is possible to have an STD causing the problem, but I don't think that's the usual reason. You would see a gynecologist if they are painful.
Thank you for your input!
It could also be your pair of Skene's glands that are infected. If anything, the antibiotics are probably helping with that. Look it up to find out your options. Good luck.
Okay... Today I soaked in a warm bath and took ibuprofen for pain and it feels much better! I don't feel as much discomfort as I did before. Thank you both for your help!