Thank you. Now it's too late to test that. I really wonder what it was
Clearly your Dr has no clue about hsv or the testing involved. All tests have a value. Your tests were negative. What he should have done was a culture of the "pimple" or lesions.
He also gave you igm tests which are useless so judging by the obvious lack of knowledge on the subject and testing I wouldn't put much faith in the visual diagnosis. I would repeat the test in another month and when that comes back negative (which it will) then put this all behind you.
Is the negative test conclusive that it is not Herpes?