Headaches in the week after head impact

I'm a 26 year old male.

Five days ago, I was hit in the head by an elevator door closing, squarely on the right side, a little above and to the front of my ear. It hurt but did not seem serious at the time: there was no blacking out, no dizziness, etc.

For a few days, there was goose-egg-type swelling at the point of impact, and the impact point was sore to the touch.

In the five days since impact, I've had significant headaches all over, like there's a lot of pressure in the head, and it gets worse if I turn my head over.

I've also felt a bit sluggish and tired every day, I've been sleeping 8-10 hours each night, but have been waking up every couple hours during the night, often with nightmares.

I've also had a stuffy nose (only on one side), occasional feelings of tingling in my head and extremeties, and a couple instances of muscles flexing (only slightly) when I didn't intend them to.

I've also had a sore neck and slightly blurry / snowy vision. I always have a sore neck and the vision problems, though this is a bit worse than normal.

There was also a couple days where I just felt really out of it, as in, almost slightly drunk/tipsy (though I haven't been drinkiing at all), not completely 100% in control of myself.

I went to the doctor two days ago and he gave examined me (no scans or anything) and said I seem totally fine and that I should go see a neurologist if the symptoms persist in a week.

Another point of note is that I have a history of having odd medical symptoms that the doctors tell me are purely stress-related. So, headaches, tiredness, and tingling, etc could easily be due to me being nervous about hitting my head rather than actually due to me hitting my head.

Also, I still have all the symptoms, but feel noticeably better today than other days.

Any insight? Thanks!