Yes, I agree. If you don't have any symptoms, then I wouldn't worry about it! Frankly, I've been bitten by lots of cats, some of them strays, and I've never been vaccinated for anything. And that goes for lots of people I know, too.
If you do have any symptoms that you, for any reason, think may be connected to the cat bite, then you should see a doctor. It might be something else, or a vaccination might not be the appropriate treatment. Make sure you know what you are dealing with.
Vaccinated for what? If you haven't gotten any disease yet, and it's been 4 yrs. Then, I would think you'd be safe from Rabies.