Low Sperm Count with high FSH, LH, with normal Testo, Estrog and Prolactin

I'm 38 year old man, and have been trying to conceive for six years. A recent semen analysis and culture came out as follows: VOLUME = 3.5ML; SPERM COUNT = 4 Million/ML; MORTILITY (Active = 60%; Dead = 30%; Sluggish = 10%); MORPHOLOGY = 60% Normal. The culture reveal a moderate growth of Staph Aureous. A hormonal analysis at the same time reveal: FSH = 26 (higher than normal); LH = 13 (higher than normal); OESTRADIOL = within normal range; PROLACTIN = within normal range; TESTOSTERONE = 7.6 (within normal range). I was told this is an indication of failed testicles, and advised to go for IUI/ICSI/IVF. I don't want to go thru the rigor and costs of IUI; ICSI or IVF. What can I do to get my sperm count/mortility/morphology back to normal, and be able to impregnate my wife, whose hormonal test came out fine and HSG fine.