This question is very difficult to answer. It is clear that you have HSV-1 somewhere, the question is where. The genital outbreak that you describe could have been due to genital HSV-1. If it was, characteristics of genital HSV-1 which differentiate it from HSV-2 is that recurrences are uncommon and many people with genital HSV-1 do not have any recurrences at all, there is less asymptomatic shedding of the virus from genital sites, and sexual transmission of genital HSV-1 is far less common than transmission of HSV-2.
On the other hand, you get cold sore (at least you think they are cold sores). It is rare for persons to have both oro-labial HSV-1 (cold sores) and genital HSV-1. The infection typically occurs at one location.
So what do to. Your doctor's advice to use condoms is a good one, particularly if your partner does not know of your dilemma, not only because of the HSV issue but also because condoms protect from other STDs. If you have another cold sore, you could get it cultured for herpes. If the culture is positive, you probably do not have genital HSV-1.
I realize this is not a yes or no answer but it’s the best I can do., I hope my comments are helpful to you. EWH
Thank you Dr. Hook. I really appreciate your advice. I definitely will use protection and inform any future partners of my situation.