People who get cold sores sometimes have a prescription of an antiviral on hand if they feel an outbreak coming on. A longer duration of a med doesn’t mean he has it genitally.
I understand that his words didn’t calm you, I know the stress. The yeast infection sounds just like that. An infection that took sometime before the med started to work or work completely. I know you are looking for answers to the other symptoms but they aren’t necessarily hsv specific. Sure hsv can cause nerve pain and a swollen node but it doesn’t sound as if you have had genital symptoms that point to infection. I can’t say yes or no to this being hsv related. Given that it was unprotected sex, I would recommend you have a final test, IgG, after 12 weeks has passed. If you get any questionable sores or marks, have them looked at but try your best to relax and see if this helps the symptoms you do have subside. The mind is powerful and while I am not saying it’s all in your head but once we get stuck on one thing, it’s hard to believe it could be anything else. Good luck.