I don't think I would not let it stop me from continuing to try for a baby. you may need fertility help from the drs but still there is no reason to stop trying.
You may want to ask you RE if IUI will help you ttc. Good luck.
I think only a OBGYN or a specialist can analyze how good the sperm is for natural conception, so is everything clear from your end, i beleive so, good luck anyway.