I asked him why he has been so distant, and it just gets thrown back at my face, that I'm the reason because I'm stressing him out, that he's too tierd, I'm over reacting and so on. So I haven't nagged him about the few things I do haha, or brought it up again. I hate arguments
Have you talked to him? Told him how you feel? That's where I would start.