I understand you are very concerned about this. At this point, your doctor must be thinking of Peyronie's disease. This is a condition wherein fibrous plaques build up within the penile shaft. This may be palpable in some cases. The shaft may affect the angle of erection. Patients with Peyronie’s, continue to have erections and sexual response remains intact. Although pain may be experienced during an erection by some patients. In some cases, a degree of curvature is noted in an erect penis. "A certain degree of curvature of the penis is considered normal, as many men are born with this benign condition, commonly referred to as congenital curvature. This causes the penis to point in a direction other than directly forward, while still having a relatively straight shaft. " The curvature for Peyronie’s is unlike this. The curvature usually leads the erection to curve forward.
Peyronie's is only a differential in your case. This has not been established yet. I do suggest that you have this assessed by a urologist. A penile ultrasound may be done to help ascertain the diagnosis