Latex does cause problems for a lot of people. If something caused you to bleed in that area, though, I would call your doctor right away. It could be a number of things, and it's not something you want to take a chance with. If it's some sort of an infection or an STD, you could be jeopardizing your health and/or your fertility.
I think there may be another forum on MedHelp that you may get more answers, though I'm not sure which one. This is a pain management forum and it's basically people with chronic pain conditions and it's a forum where people mostly support each other and give suggestions. If you click on the Forums tab at the top, you can look through all the other forums here and see which one would be best. It may be one on sexual health or allergies. Or both. Best of luck. Please get it checked out as soon as you can.
Latex, which condoms are made from, is a very common allergy. So yes, it most likely could cause bleeding and other problems. It would probably be best to see a doctor so you can be tested for that allergy. If in fact you are allergic, you would want to make sure all health care professionals are made aware.