I have this. I was told it could be tinnitus.
Yes, you should get it checked out. You may need an MRI or CT to rule out things like a fistula or other blood vessel problems. There are a number of things that could cause your problem, but you should get checked and rule out things that if left untreated could seriously affect your health.