I agree with happynifer. absolutely, keep doing what you're doing. so many women don't even know they're pregnant and they are working out hard. I also stopped working out during IVF because the meds i was on were hyperstimulating my ovaries but if i was trying the traditional way -i wouldn't have....
it's absolutely fine. you can't shake the baby out :)
and maintaining your health and fitness reduces stress (and stress has been proven to affect fertility), maintain a healthy body weight and make you feel better about yourself.
i decreased my high impact exercise around egg retrieval for IVF, but only because my ovaries were enormous and high impact exercise with that many follicles can cause the larger ones to rupture (rare, but it can happen).
i continue to work out with my trainer and am 31 weeks pregnant :)
good luck!
my doctor said to take it easy post ovulation. just try not to stress your body.