You can cover the rashes with a salve (such as aloe vera, or another form of lotion), and put some ice for a minute to help ease the pain. If it's that painful, you can take an analgesic such as ibuprofen. If gauze is too difficult/awkward to apply, you can get one of the larger-sized bandaids with a small ring of adhesive tape on all sides, or gather a large cloth/chunk of cotton and carefully tape it over (if it's an allergic reaction to the adhesive tape, don't follow that method). Consider staying relatively inactive until the boil has healed, and don't push yourself (this will make the boil and rashes worse). You can rub them in sanitizing wipes or nitrogen peroxide to avoid infections, or cover them with clean tissues when you're not moving to keep them covered without the adhesive tape. I recommend nitrogen peroxide for your boil if you haven't already been using it.
didn't mean to post this in the women's section hold up