Talk to your doctor about it
My dr says you need to be healthy for the baby to be healthy. I've been taking my anxiety and depression meds since day 1 my psychologist took me off the medication and i got real depressed and my anxiety i couldn't control the baby started to go thru withdrawal my obgyn put me back on the medication immediately I'm due feb 22 and baby looks very healthy.
Depression is real and pregnancy can make it a little worse at times because if your hormone overload.
Talk to your OB if you're concerned, they may lighten your dose or even try a different med but I know a Lot of women who've taken depression meds the entire pregnancy and have healthy happy toddlers now.
I've been taking lots of medication throughout my pregnancy which could potentially harm baby and at every scan we've been told she's been doing absolutely great, like others have said you've got to make sure you are well so that baby is well. Not being horrible to your ex but it sounds like he's being a bit insensitive and doesn't really understand what you are going through (saying it's all in the way you think about things) :( I think a lot of the time they don't know if certain medication is harmful to baby because they just haven't tested it on pregnant ladies. Please keep yourself well, I am sure you are doing brilliant at looking after your little one already and will be an amazing mummy to him/her when they get here :) x