Do you normally get sweaty palms?
Just from what you've said it "could be" dishydrotic eczema. That's where sweat gets trapped under the skin and gets quite itchy.
It turns into an "itch/scratch" cycle where the person keeps scratching it, more bumps appear, more scratching.... Eventually the skin starts to peel where it seperated from the base when sweat was trapped.
Instead of itching, try using hydrocortisone cream and "gently" rub the area with it when it itches.
If you have open blisters than put some hydrocortisone cream on them and cover them with small strips of saran wrap.
Let's say you purchase 2% hydrocortisone cream. When you occlude it with saran wrap the heat increases it to a higher percent.
In reality, if it becomes an issue, see a dermatologist for "cortisone cream" which is more potent.
I may at night and not know. I usually wake up with the bumps. The thing is they don't itch at all. I will try the cortisone cream just in case.
Two possibilities are there for these kind of lumps. First possibility is of myxoid cyst. It is a growth usually occurring on the finger. These cysts are believed to form from deteriorated tissues. Third possibility is of herpetic whitlow. It is a painful viral infection occurring on the fingers or around the fingernails. Herpetic whitlow is caused by infection with the herpes simplex virus (HSV).
I sincerely advise you to consult a dermatologist and discuss these possibilities with him.
I would suggest a clinical examination done by a dermatologist. It is very difficult to precisely confirm a diagnosis without examination and investigations and the answer is based on the medical information provided. For exact diagnosis, you are requested to consult your dermatologist. I sincerely hope that helps. Take care and please do keep me posted on how you are doing.