I am in the same position with my husband. He is taking Lyrica and we would like to try having our first child. I know this was two years ago, but did your husband end up going off the Lyrica before you conceived?
It is advised that if one wants to father a child while on Lyrica, to discuss this with your physician. Find out what may be involved first. It may be that he would need to discontinue the medication until you become pregnant. I can understand your concern and would certainly want to know the specifics about the effects it could have on the fetus.
You may want to ask this question in the pregnancy forum as well. Someone there might have been through this previously and could give you more info., but I would feel more comfortable speaking with an MD.
Take care.