Hi there!
While prognosis may not be excellent with haemorrhagic stroke, your doctor is correct. Deterioration after initial progression could indicate another stroke/ mini stroke, issues with microcirculation or other neurological conditions. I would suggest considering a review with his treating neurologist for an accurate diagnosis and appropriate management.
Hope this is helpful.
Take care!