I would definitly contact your doctor about this. It takes a long time for most doctors to diagnosis headache problems so the sooner the better.
It took over a year and half before I even got a dx of interracial migraines with auras. Im STILL dealing with finding the right med combo for it.
Blessings!!
IIt doesn't sound like the biggest deal to me, especially with them not lasting long and you don't say that they are severe, but then I'm not a doctor. I would definately calendar it to know exactly how many a month that you have. It may be more than you think. If you are taking any pain reliever, even OTC ones, more than twice a week you risk rebound headaches.
I don't think that it ever hurts to tell your doctor about a problem. You can listen to what the doctor has to say and then make your own decision about what to do.