Hello,
I would certainly stop the caffeine entirely, even de-caf as there is a small amount that can not be removed. Do you have any known environmental allergies, sometimes they can cause the higher heart rate. I know this sounds silly, but I would also see a chiropractor. You see, if certain nerves, etc are impinged, they can cause issues, if the one to your heart is impinged, this could be causing some of the issues.
Your resting heart rate is POOR, considering that for your age, gender and fitness profile it should be 54-65 instead of 85 -105.
You may try to follow the advice from AndrewRynneeMD,
do some transdermal magnesium treatments (look it up online)
and also do some meditation to bring your stress levels down.
If you can't get into meditation, try the free software from the brain wave generator to create your own binaural sounds to help you lower your brain activity, so you can de-stress, learn easier and faster, sleep better etc.
If your heart rate remains high, after all this, then you must get a medical evaluation to rule out tachycardia or other abnormality.
I hope this helps, however, please note that my comments are
not intended to replace medical advice.
Best wishes,
Niko
It may be worth while going caffeine free for a month or so. Discontinue all coke, tea coffee except decaffeinated versions I hope you don't smoke and if you use alcohol that you do so in moderation.