Be very careful on what you read about infertility and HSV. Much of it is hype by sham HSV 'cure' or treatment products.
Men can have HSV and have normal sperm counts. For some men, a reduced sperm count does occur as a result of HSV and antivirals do assist in restoring the count.
It does not follow that all men with HSV have infertility problems. You are more likely to experience infertility from other causes than HSV.
the thing is, is that you have to protect her from your bodily fluids by using condoms :)