If you are having chest pains, always call your doctor- it's important to get checked out and not mess around with chest pains of any kind. Also, when you switch medications or are just taking a new one- report any changes to your doctor.
Exercise can be a big help, but you don't want to just stop taking medication. If you have reservations about it- talk to your doctor and see if you can come up with a plan for addressing the issue with a goal of no medication.