The only time he should stop is if your water has broken. Until then keep doing it, baby is well protected. They even recommend it much later on to help with your cervix as sperm contains prostiglandans which is what they use when they induce you.
It's still safe. Won't harm baby.