Point out that his temper is a problem and he needs to grow up cuz you dont need him being like that teaching your kid how to throw bigger temper tantrums. Kids reflect off of their parents. Do what's best for your baby.
Yea I feel like should stay with my family but he feels like if I stay with my family we not going to be a family
If you feel that it isn't going to be safe for you and the baby because of his anger problem then I wouldn't move in with him. .... if he doesn't want to be with you because of that then you just need to do what is better for your baby. ...... maybe try suggesting he try counsiling to help with his anger.
Do what is best for you and your baby.