It sounds like more than just dry skin--perhaps a little touch of eczema aggravated by rubbing from your clothing. Anything you can do to pad the area so it doesn't rub will help. You'll also need to see a skin doctor, probably just for one visit, to get a specific diagnosis and proper therapy in case it returns from time to time.
Take care.
Dr. Rockoff