First, you need to see a specialist, not your primary care doc and a regular physical. There are problems that affect the voice. If it is anxiety, you would first be feeling nervous and anxious probably about singing. It could be your posture, disc problems, all kinds of things that voice specialists would know about but your primary care doc wouldn't.
So what's your main problem the singing?