Hello,
One possibility for your symptoms is pompholyx. Pompholyx is also called dyshidrotic eczema. It is characterized by a sudden onset of many deep-seated pruritic, clear vesicles which itch and then peel off. As a result the skin may also fissure.
The exact cause is not known and excessive sweating can be one of the reasons. But some triggers like allergic reaction to soaps, detergents, foods, latex, nickel etc may trigger the symptoms. Apply some calamine lotion on the affected area and keep the area well moisturized. Use only thin applications of moisturizer ointments as excessive amounts of ointment may restrict breathing of the skin and aggravate the condition.
Topical steroids can be applied but they are available under prescription. Moreover to prevent infection, topical antibiotics may be needed. I suggest you to consult a dermatologist and get it evaluated.
It is very difficult to precisely confirm a diagnosis without examination and investigations and the answer is based on the medical information provided. For exact diagnosis, you are requested to consult your doctor. I sincerely hope that helps. Take care and please do keep me posted on how you are doing.
Just to add: I actually just looked and one of my elbows in the mirror and there are a lot of tiny red bumps all over it... just one not the other. And there are a few tiny bumps on the toes of both of my feet :(