Yeast and fungal infections don't keep coming and going in the way you describe. Irritations do. I suggest either minimizing the friction-inducing activities, or mitigating their effects by applying moisturizing creams and over-the-counter 1% hydrocortisone when the redness appears. There's no issue of transmissiblity, to your hands or to anyone else. You just need patience (and acceptamce that irritations do come from time to time), not abstinence.
If this regime doesn't work promptly, have a doctor check you out, just for peace of mind.
For what it's worth, yeast infections, common in women, are not often translitted to their partners.
Best.
Dr. Rockoff