You dont have to start counting kicks until about 28 weeks
How far along are you?
I'm 20+4 weeks and some days I feel like all day and the next I feel him like maybe once. It worries me a little but I think if you're stressed/busy it makes a difference