which went inside my vagina right after. I am freaking out that I got it from him. Even though the cold sore itself didn't touch me I just worry because the saliva was in his mouth by the cold sore. Any medical or .professional advise would be appreciated
Just because the virus touched you doesn't mean you get the virus instantly.
There is a very low risk here and I wouldn't even lose sleep over it. If something should happen (not saying that you need to be on the look out) be seen by your provider for a proper work up.
have you ever been tested to know your own herpes status? even if you can't recall any obvious cold sores ever, that doesn't mean you aren't also hsv1 + yourself.
saliva itself is a poor means of transmitting herpes. you have always been at higher risk of contracting your husband's hsv1 infection orally than you have been genitally. I really wouldn't worry too much about this incident. certainly get tested at some point to see what your status is if you haven't been tested in the last year for herpes to see if you even have to worry about hsv1 transmission or not.