It's possible, in theory, if it was still wet, but if you didn't have an outbreak, it's not likely. Make sure to keep your wash rags up out of reach, or make sure he knows he has his own - color code them if you must - and make sure to do the same with towels. This isn't just for herpes - it's far more likely to spread fungal infections like jock itch, etc., this way.