it sounds like it is a allergic reaction you should see your doctor your doctor can give you something for it
It's probably an allergic reaction to the soap. Maybe try another shower and use a gentle soap, ensuring to proper rinse. Try not to irritate it more by over-washing. Sometimes the cream you get with as a supplement to yeast infection treatments helps keep from itching. Ibuprofen for the swelling.