Hi, I can't really say what this is, but I get them quite often myself, as does my daughter..so I wouldn't worry too much, it could be hair follicles that are causing them rather than ingrowing hair tho. Do see a doctor or practice nurse if you're worried tho.
Have you tried popping it like a pimple? It can be an ingrown hair, even though you don't shave or even a black head....try a little squeeze (not a strong one) and see if anything comes out...If it does, it is just an oil gland or a little cyst.