I completely agree with Annie. Your husband needs to be present for some of the visits. Especially the consultation and testing, egg recovery and embryo transfer at the very least. This is a forever commitment and the doctors need to feel your both invested in this process and babies life.
My IVF doctor had a whole raft of tests the couple needed to do, not just a sperm test, including for carrying genes indicated for cystic fibrosis (I think) and other conditions. There was also mandatory counseling for both people in the couple and explanations of all the shots the woman would have to take, they trained the husband in giving the wife the daily intramuscular shots. Possibly that is why your husband was asked to come. My doctor also had a pretty strict rule about not wanting to treat people with "disinterested husbands," which of course when you have a husband travel is a tough one to have to argue with a doctor about if he gets the idea your spouse isn't coming because he doesn't care much about having a baby. Have your husband attend the appointment, or call your doctor's office and explain that your husband travels a lot and this was rather short notice, and ask if it can be rescheduled.