I agree with Bethesda. A similar thing happened to me and my PCP told me to go for a 2nd opinion. It was the best thing I could have done. The new gyn was awesome, listened and I am now recovering from the exploratory laparotomy he performed on me on Dec. 20th!
If I were you, I would just go to a different GYN. Just because your PCP recommends a particular one doesn't mean you HAVE to go to him/her. Ask your friends for recommendations. That's how I found my current GYN (who I absolutely love). If you're concerned, I would definitely make an appt with a new GYN to put your mind at ease. Don't stick with a GYN you don't like. There's no need to.
Best of luck to you.