Prostate is the one organ I would look at closely. Infection of the prostate, or prostatitis, can lead to the symptoms you are describing.
I would start with a thorough digital rectal exam. If there is any prostatic secretions expressed, this can be sent off to the lab for culture and analysis.
You can also consider a transrectal ultrasound to image the prostate for any abscesses.
There are some cases of prostatitis that can require an extended course of antibiotics. If there is evidence of an abscess, this would need to be drained.
You can discuss these options with your personal physician, or in conjunction with a urology evaluation.
Followup with your personal physician is essential.
This answer is not intended as and does not substitute for medical advice - the information presented is for patient education only. Please see your personal physician for further evaluation of your individual case.
Kevin, M.D.
Medical Weblog:
kevinmd_b