I had terrible vertigo for a year and a half several years ago. I was pretty desperate at the time as it would start and I would be debilitated. I get nauseated with it which did me in. I have to lay flat on my back until it passes and it can take 2 to 4 days for that to happen. I started at my GP and ended with an ENT. I learned a lot during that time. Some people have a virus that can cause the symptom. Others have an issue with a nerve called the vagus nerve. I had Eustachian tube dysfunction. My big fear at the time was that I had Menieres Disease. From your description, perhaps you have an issue with your vagus nerve. An ENT can help you with that. https://www.psychologytoday.com/us/blog/the-athletes-way/201909/how-is-the-vagus-nerve-linked-head-spinning-vertigo The vagus nerve is actually really long from spine down to your gut. This link gives a very nice summary of the vagus nerve. https://www.neomedinstitute.com/blog/why-you-should-pay-attention-to-your-vagus-nerve can be the outcome.
When the ENT helped me with the issue of my Eustachian Tube dysfunction, I got better. I had an issue 5 years after that and still don't know if it was the Eustachian Tube issue or my vagus nerve. I was out like I had been previously for 4 days. And for me, when I say out, I mean bedridden. I'm a mom, that does NOT work. Luckily that has now been about 6 years since that happened with no further episodes.
Talk to your doctor. good luck
Probably hard to find anyone who doesn't have some misalignment. Not sure it would cause what you're complaining of unless there is severe nerve impingement, but even then, not sure it would be manifested this way. You were told you don't need surgery because, again, we all have some of that or a lot but it doesn't necessarily cause the pain most associated with it.