Some people are foot fetishists. You could look up fetishes -- they probably come from an association happening between early sexual feelings and something having to do with the fetish object. Apparently fetishes are not entirely uncommon. Maybe that is what you have, and if it is bothersome to you, you could go into it with a therapist to see what caused it and perhaps how to move past it.
Maybe you don't like jacking off.