Should you be worried about what, exactly?
How long before the guy 3 months ago was your previous encounter?
How was this diagnosed? Did you have symptoms, or did they find it when doing your pap test? There can be false positives when doing the test with your pap, so it's possible that you had a false positive if you had no symptoms. Can you find out from your doctor what the name of the test was? Maybe you can access the patient portal?
If you are concerned about notifying your partner, and you've tried contacting him a few times, then I think you've done what you can.