Having stones in kidneys is called nephrolithiasis. If kidney stones are not removed then they can cause decrease or loss of function in the affected kidneys, kidney damage or scarring, obstruction of the ureter, recurrence of stones and urinary tract infection.
Hence they should be treated at the earliest.
I hope it helps. Take care and regards.