I assume a blood gas test has been performed to establish oxygen levels are normal in the blood? If so, and clear, then maybe infection because the bodies natural defence against infection is to raise temperatures.
However, it depends on what you class as hardly breathing. It is normal for patients after heart surgery to take shallow breaths due to the discomfort in the sternum. Expanding the ribs really hurts and of course respiration does this. I remember after my bypass surgery I perspired a lot, but they said this was normal as the body was taking measures to make possible infections uncomfortable. I'm not sure if this is the case because even after 5 years, I still perspire a lot more than I ever used to. Maybe now my arteries are unclogged, my temperature is being better regulated.
It would be best to check with the doctor/surgeon to rule out pneumonia or pulmonary embolism.