I would go they are there to help you and thats what they get paid for, I would rather be safe then sorry. But don't worry I always hesitate too.
I would call the doctor and see what they think. If they're concerned they'll tell you to come in or go into the hospital.