Headaches could also be high blood pressure which is a sign of preeclampsia make sure you mention it to your doctor
Just take Tylenol it's common especially first trimester a little in second too
I got them alot around that time but now I dont get as many hope you get better with them
Headaches are common during pregnancy due to the increased volume of blood your body is making for your baby,i get what your describing too like tension headaches,not something to worry about but do always mention it your doctor if your worried or if they get really bad i would go get it checked it just to be on the safe side