It's possible that you may just be having allergies. Do you have a stuffy/runny nose also? I get watery, crusty eyes from allergies also. Sometimes with runny nose, but sometimes it's just my eyes. Try taking an antihistamine, or maybe some eye drops made for allergies and see if it makes a difference.
It is possible that you are having a reaction to the solution(s) that you are using to clean or put in your contacts. I would try another brand. Call your eye doctor and have them suggest one that is known to be less irritating. I had to do it myself years ago! I changed brands and the problem was solved. Good luck and take care!