Yesterday I was on my way to the library to return some books. Outside of a library, a man came up to me and extended his hand to shake it. I was hesitant, but didn't feel comfortable enough to decline, and I shook his hand. It felt dry, I didn't notice any cuts but the handshake only lasted a couple seconds. He asked for money, I told him I didn't have any cash on me, and I went into the library to return my books in the book slot. I left the library after like two minutes, and went back outside. I forgot that I had shaken his hand, and for a brief second or two, chewed at the loose skin (yeah its a nervous habit) on the side of my thumb (same hand I shook hands with). I don't think that part of the thumb touched his hand, but as indicated by this post I'm worried.
Is there any risk for herpes from this contact?
Also (somewhat related), any tips on how to politely decline a handshake?