IIt doesn't sound like the biggest deal to me, especially with them not lasting long and you don't say that they are severe, but then I'm not a doctor. I would definately calendar it to know exactly how many a month that you have. It may be more than you think. If you are taking any pain reliever, even OTC ones, more than twice a week you risk rebound headaches.
I don't think that it ever hurts to tell your doctor about a problem. You can listen to what the doctor has to say and then make your own decision about what to do.
I would definitly contact your doctor about this. It takes a long time for most doctors to diagnosis headache problems so the sooner the better.
It took over a year and half before I even got a dx of interracial migraines with auras. Im STILL dealing with finding the right med combo for it.
Blessings!!