Besides your obvious awakenings, you probably have many more subconscious, micro-arousals, with prevents you from ever achieving deep sleep. This causes a low-grade stress response which also causes your involuntary nervous system to become hypersensitive, or "en garde" all the time. So then all your senses and even your emotions overreact even at the smallest things. To address anxiety issues, there are three ways to address it: take medications to help numb your nervous system, sleep better, or take part in activities that help to calm or relax your nervous system (such as exercise, yoga, breathing exercises, or tai chi).
Take a look at my two (blog) articles, Anxiety and Sleep Position, and the Male Menopause Myth, for more interesting explanations about your condition.