Why do you want argue? The adult thing to do is talk about it.
I feel this way sometimes... It's usually because I'm already worked up or my emotions are running amuck. Just take a step back and realize that life is not perfect and things sometimes don't go as planned. If he's not argueing back it's probably because he doesn't want to rock the boat more. My fiancé usually doesn't fight back and we talk about whatever it was after we're both cooled off. For me things can get overwhelming and then I get upset. Take a breather and then revisit the issue when you feel better.