Oh hon, no. Herpes isn't transmitted like this at all.
First, herpes dies very quickly once exposed to air. If you had any virus on your fingers, and that's a strong if, it would have died long before your daughter came in.
Second, if you had virus on your hand, there probably wasn't enough to transmit it to anyone after just a quick scratch, especially when you didn't have an outbreak.
Third, even if this was a sexual partner, and you touched yourself then immediately touched your partner's genitals, it wouldn't transmit. Hands are just a really inefficient way of transmitting any STD.
While you can infect yourself by touching an outbreak, then immediately touching your eye, this almost always happens when you are first infected. There is a lot of virus present then, and you have no antibodies to protect against this.
You are not a walking bio-hazard, just waiting to infect someone. The ONLY way you will infect your children is if you have inappropriate sexual contact with them. Please do not avoid normal interaction and contact with babies or especially your own kids. Don't deprive yourself or them of this special love. It's unnecessary.
A side note - most ocular herpes infections are hsv1, the result of the virus traveling up the nerve to the eye, not hsv2.
You deserve to have a full life, a fully wonderful relationship with your kids. Don't let herpes hold you back. It doesn't have to.