This sounds like dyshidrotic eczema, a non-allergic skin irritation. You don't have to treat it at all if it doesn't bother you, but if it does, 1% hydrocortisone may help. If not, a doctor can prescribe a stronger one. The condition comes and goes.
Best.
Dr. Rockoff