Generally, if you are active now with exercise and not having limiting symptoms of chest pain or shortness of breath I think you should be fine with your move to Colorado. Initially, you may find yourself getting tired or short of breath faster at the higher altitude, but this will improve with time.
quite possibly as Denver is a mile above sea level I believe? You would need to ask your own Doctor this because the answer depends on many factors of which none are specified.