Receeding hairline at 22

I'm a 22 year old male.  Ever since I was about sixteen, I noticed my hairline on the sides went in a little far.  However, it seemed to have stopped at that point, and I kind of forgot about it.  Now at 22 it has advanced about a quarter of an inch (or seems that way, impossible to know for sure, as I wasn't taking precise measurements).  There are some days where lots of my hair falls out, and everyday I notice a little bit more on my comb as I brush through, and I can tell it's thinning when I get it wet.  

All the men on my mother's side have hair, and they're all in their early sixites.  I have no clue about my father, as he was out of my life before the day I was even born.  

Is it possible it comes from stress?  Daily life in my household is a tad stressful, more stressful than usual.  

Is there any way to stop it?  I know of the hair regrowth chemicals on the counter, but those are for people who are outright bald.  I don't want to overdo it, and damage my hair even worse than it already is.