Calcium frequently deposits at sites of previous infection with TB or fungi. These “scars” are called granulomas and are of no consequence in an otherwise healthy individual. Specifically they have nothing to do with cancer and they cause no other respiratory disease.
However, there are reports of reactivation of the infectious agent (TB or fungus) that caused the granuloma to form in the first place, in immunocompromised individuals or the elderly and/or infirm. This is probably less likely to occur with more densely calcified granulomas.