From your description, I'm not convinced the provider used improper sanitary technique during your biopsy--but if he did, it certainly doesn't explain any of the other problems you describe. None of your symptoms is suspicious for any kind of infection and almost certainly were coincidental to that procedure. As you have been told, they indeed are strongly suggestive of a psychosomatic origin.
Presumably you mean LGV (lymphogranuloma venereum). I have to be skeptical of that diagnosis. A blood test alone is not sufficient to diagnose LGV; the blood test is notoriously unreliable, and you don't describe any symptoms that suggest LGV. It is a vanishingly rare diagnosis in industrialzied countries. In 30+ years in a busy STD clinic, I have never seen a case. The most common form of LGV today is as a rectal infection in gay men, and even that is very rare.
As to your current symptoms (rash of the thighs and groin, body aches, red blotches and bumps, etc), they don't suggest any STD, or any infection you could have acquired in a doctor's office. Return to your provider if you remain concerned about them, or find a new provider if you aren't convinced your current one is doing a proper job. (If you are certain the red blotches and bumps are abnormal, you might want to see a dermatologist.) But be prepared for the near-certainty that whoever you see is going to be suspicious of an emotional origin for many of your symptoms, if not all of them.
Good luck-- HHH, MD
Also, could the LVG still be lingering in my body? Thank you.