Is it possible you are being very hard on yourself? I would talk to him. I have read lots of posts about girls that feel the same way. What if he is just afraid to be intimate and thinks there is a possibility of hurting you or the babies. The best thing for you to do is talk to him.
Don't feel that way he's probably just scared he might harm the babies