It could be a skin infection like, cellulitis, which is treatable with antibiotics.
I'd encourage you to visit your obgyn. Given your symptoms, you may have an STD, trichomoniasis, or a vaginal infection, all of which will require a prescription med to cure. The latter two you don't necessarily have to be sexually active to be infected.