There's a form of cystic acne that does what you are describing. It can even leak a fluid like the kind of orangeish water sometimes seen on the inside of a bandaid over a cut.
See your doctor, and get on a prescription for an antibiotic, tetracycline, doxycycline or the like are often used for skin issues like this. It takes a little while on the antibiotic, but after a while (if you take your antibiotic regularly) it will heal and then you can just use a Retin A ointment on your skin and it will prevent more of those from happening.