You can tell them you might have gotten it orally, but aren't sure, as you've never had an outbreak, if you kissed the person who gave you oral when you were infected.
There is a lot of debate on whether or not you should disclose before kissing, and I have to say that in my 50+ years, no one has ever disclosed to me. It's up to you on what would make you feel okay with it all.
Yes, it's possible to transmit to a baby if a mother is infected during late pregnancy, but it's rare that it happens. Also, ghsv1 is rarely transmitted genitally, and while hsv1 can be transmitted orally, what other people do isn't your responsibility. It's kind of you to worry about that, but I suspect it's also anxiety.
Ghsv1 transmission - https://westoverheights.com/forum/question/advice-to-prevent-transmission-of-genital-hsv1/