Get a new doctor.
"I’m at risk of waking up one day with genital sores" - not true. You can transmit it to other locations in your body by touching an outbreak on your mouth and then immediately touching your genitals, for example, but this happens mostly when someone has a new infection and doesn't have antibodies yet. You do, so this is highly unlikely to ever happen.
"by having unprotected genital sex I could give somone my HSV1 despite never having any infection in my genitals ( only ever my lips)because the virus lives in the blood" - so, so untrue. Herpes isn't in your blood - it resides in your nerve groups, and you are only infectious from the area that you are infected. You have it orally - you get cold sores. You are only infectious from your oral area.
You could transmit hsv1 to someone's genitals by performing oral sex on them, though. Make sure to never perform oral when you have any symptoms at all, and make sure your partner knows you have it. Your partner should also test for hsv1 (and 2, because you are still at risk for getting type 2), because if they have type 1, you can't give them something they already have.
Seriously, find a new doctor. This one is terrible.