Granulomatous disease is not associated with sleep apnea. It describes a specific microscopic picture caused by tuberculosis or fungal infection, with the organisms now encased in the granuloma and dormant. That is not actively infectious. It is a very common finding, one that is noted and then pretty much dismissed. There are also non-infectious granulomas, such as sarcoidosis, but that is not what the report refers to in your case.
Granulomas are noted for showing little or no changes in size over long periods of time.
1996 is a long time ago. You might want to have another x-ray to confirm that these "granulomas" are stable.