Hello~You said you have been to two doctors, have you been to a cardiologist? I really think you should ask for an echocardiogram, stress test and an event monitor that is worn for either 24 hours or an entire week. If the pain is related to your heart, then it will surely show up in at least one of these tests.
If all these test have good results, then I would suggest seeing a chiropractor, you may have some pinched nerves in your mid to upper back causing the pain. The chiropractor will take some x-rays, study them, go over them with you and discuss if treatment will help. If he/she feels that treatment will help, then after a few adjustments, you should start to feel better.
I am not familiar with that vaccine, I did a small Google search on it and I didn't find any serious side effects. Again, I would discuss that with your prescribing GP.