You had safe sex and your symptoms don't suggest HIV or any STD. That includes both the groin pain and your cold symptoms. Anybody close enough to have sex is close enough to catch a cold, even without kissing. But you are equally likely to have caught it somehwere else. In any case, it doesn't sound serious. If you're worried about HIV, get tested; but you can expect a negative test.
Good luck-- HHH, MD
And yes, you can get a cold from anyone you are in contact with.
But Englishman has it right: see a health care provider if you remain worried.
HHH, MD