There is definitely either a problem with the fit or your eye's tolerance to the lens which could be affected by things like allergies, drye eyes or overuse. See an ophthalmologist to try to get it figured out and quit the contact in the meantime.
MJK MD