Your child is a blessing to you concentrate on your little one and do not stress as that little miricle grows in you, your answer will become clear in no time :)
As much as it hurts there is somebody out there that will love you and your baby no matter what, not just when it is convenient for them. He doesn't seem to be making an effort to "be a family" if he ain't even going to the appointments. If he really was trying then obviously my response would be different.
Be done with him! If men truly care they will show you. My husband works 14-16 hour shifts and helps me and is always there whenever I need him. You deserve so much better!