I don't think you need to avoid it entirely, but reducing portion sizes or considering brown rice (which has more fiber and might fill you up more) is a good idea! Another possibility is to consider quinoa, which has more protein and fiber, and few calories than rice.
I'm half filipino, so I LOVE my rice, I would eat it with everything. But I decided to forgo my beloved jasmine rice for some brown rice. And, the brown rice was not the same, so I decided I would rather not have it at all. Like the dr suggested quinoa is rather delicious, I love this stuff. I don't have it very often. I do eat rice occasionally, maybe only a few times a month, but I have cut the portion size in half of what i used to eat before.
So meaning I will just eat a little amount of it.