Hmmm... It sounds a little like a Urinary Tract Infection (' UTI '), but normally the pain or irritation doesn't go away after peeing, in fact it often feels like a constant need to pee. I think it would be best for you to see your regular Dr. first, probably will check for a UTI, if he/she can't find the cause or a treatment that works, see a Urologist.