You are more likely to contract hsv1 orally than genitally. You've never had genital symptoms but you have had oral symptoms. It's likely that your hsv1 is oral only.
grace
I guess it's a possibility, but probably quite low. Unless you have an outbreak, I don't think theres anyway to know. Personally, I wouldn't worry about it.