These can be due to folliculitis.
Apply warm compresses,Neosporin ointment and calamine lotion and avoid messing with it.You can take anti-inflammatory pain killers like ibuprofen or acetaminophen.If the lumps persist then it will be best to get it evaluated from a dermatologist.
It is very difficult to precisely confirm a diagnosis without examination and investigations and the answer is based on the medical information provided. For exact diagnosis, you are requested to consult your doctor. I sincerely hope that helps. Take care and please do keep me posted on how you are doing.
Get tested it could be herps very scary and please stop trying different things it may be making it more irritated