Stop using that soap. Sounds irritating and you may be reacting to it. Not sure what the bump is. Wart? Hair follicle? It should probably be seen by a doctor.
Get a hot washcloth compress and put it in it 2x a day if that helps and starts to shrink it's probably razor bumps.. if it itches it could be molescum look that up see if it looks like the bumps those spepread if you pop them.. I would defiantly make an appt to see your gynecologist though..