That is actually pretty normal. The important number for heart rate recovery is how quickly it drops intially after your work out -- from 170 to 100 over a few minutes. If you work out hard, it may take several hours for your heart rate to get back to a normal range.
Hope this helps.
I also, after excersise develop anxiety, which in turn makes my HR rise again after stopping my workout. I suffer from Panic/anxiety ALOT! It sucks, but wont kill me. My answer to you would be YES. If you are worrying about your HR, you will become anxious about it. I do every day I work out. Its a bad cycle, but I deal with it.
I am 22 years old....if I run for 40 minutes and get my heart rate up to 170 for the majority of the run.....it will take 5 minutes to come down to 120. During this 5 minute time period i am slowly jogging and then switch to a brisk walk which I would assume could be partially responsible for the time it takes to come down? I've recently had panic attacks and increase in overall general anxiety..could this also contribute even if it is on a subconscious level?