I had this before too and it was comparable to a callus that you get on your foot. I used different lotions and a loofah pad and over time they went away.
It could just be scar tissue from slight injuries to your knee or it could be something else. If they are bothering you, make a doctor's appointment to have it looked at to see what exactly is going on. Then you can treat it depending on what the diagnosis is.