Unless you have video or audio proof, I highly doubt it. I would consult a lawyer. Remember when you have joint custody you are entitled to call the police to do welfare checks at his home. So if you can't build a good case before hand, I am sure if they are shady people then you can have the police do a welfare check and see if they find anything.
That is all hear say in the judges eye.