I have Multiple Chemical Sensitivity (MCS) and chronic migraines. What you're describing is something that happens to me around the various chemical smells, regardless of whether they are pleasant smells or not. To answer your question, YES, you can have an immediate reaction as you're describing. No doubt they are neurotoxins.
You need to find the source of those chemicals and remove them from your environment.
Even if it isn't classic brain damage, as medical professionals would define, neurotoxins do all kinds of damage to our bodies. Some of us just happen to be a lot more sensitive to these environmental toxins than others are, much like canaries in the mine. These chemicals are actually bad for everyone, only everyone doesn't realize it.
Since most people aren't so sensitive, they scoff at those of us who are greatly affected by these chemicals. Ignore the nay-sayers and their comments. They simply don't understand the misery that these neurotoxins cause those of us who are very sensitive to the chemicals. These are the same ones who take offense when someone tells them that their perfumes and fragrances make one sick--no matter how gentle and careful one is to show regard for the other person's feelings. As long as you're not being unkind, ignore the people who insist on taking offense. They're not the ones suffering, so they lack the ability to understand.
Yes, you can have immediate reactions to the said inhaled chemicals. You need to get those chemicals out of your environment as soon as possible, because you're affected whether you're close enough to smell them or not. You will only continue to get sick.
Yes, this is migraine induced by smell. Find the source of the chemicals and remove them from your environment as soon as possible.