I'm bad at making decisions sometimes, because I want to weigh all possible outcomes. But often I find I've already made my decision and that I just need to have it validated by others or i need to admit it to myself. I think you've already made your decision, that this isn't a lifestyle you want for you and your children. It's a tough choice to be sure, and counseling may fix it, but he's already not confiding in you and is reluctant to go through with counseling or even show affection for you. No matter what decision you make or what happens with this relationship, I'll be thinking of you and I wish you all the best.
Going through this alone is hard as you already knew that. If I where in your shoes.. I would probably go on about my way you can't make him grow up or be ready. Sounds like he has other priorities right now. You don't need the extra stress of this. Go with your heart or gut feeling. If he stays will he be of any help to you and kids/baby? You are the only one who can say what is best and when enough is enough. I wish you lots of luck.
Don't ignore the signs, he's telling you to run!!
Just ask yourself if it were your daughter in the situation would you want her to stay with a guy like him?
Let the extra baggage go. He's not worth the headache. Best of luck to you!!
Always remember what you want and how you want to be treated. Don't compromise yourself, your feelings, your standards to lessen your value. Don't expect another to change in order to rise up to meet those standards you create for yourself. They will either be there or not. If the answer is not, then let go- life is WAY to short! Love yourself first and ALWAYS!
I hate to encourage anyone to go it alone, but you deserve far far better than what this jerk is giving you mama.