While it's possible to get herpes that way, it's not at all likely, especially if he didn't have any sores. Herpes also wouldn't cause symptoms that fast. My guess is that your anxiety is playing tricks on you, and I don't say that to diminish your symptoms - anxiety can do real things to our bodies.
If you aren't already, please talk to someone about your anxiety. (I say this with compassion and not criticism.) Your fear of herpes may not go away, but you can learn coping skills for living with anxiety to make things easier for you.
Have you had any sores? Without sores, this doesn't sound like herpes symptoms.
This sounds like anxiety to me, but if it lingers, see a doctor. Be sure to talk about your anxiety while you're there. You don't have to live like this.