Based on the info in your post--this can't be right.
You need to get retested with a Herpes Select.
Remember if the HSV2 IGG antibody number is 3.5 or less
you need to have a Western Blot to confirm the diagnosis.
Unfortunately, there's a lot of mis-use and mis-interpretation of these antibody tests.
Your result numbers indicate an older test, maybe a combination non-type specific test, or worse an IgM test. The Doctor will most likely recommend a followup test with a more accurate IgG type specific HerpeSelect test. Assuming you live in the States, ask for it by name, and skip the older IgM test, they're unreliable for herpes testing.
As others already replied (below), it seems likely you did not have one of the newer, accurate herpes simplex virus (HSV) antibody tests. The results indicate you are infected with HSV, but it is completely guesswork as to whether you have HSV type 1, 2, or both. Also, your doc's diagnosis of "recent" infection suggests that one of the tests was for herpes IgM antibody, which is notoriously unreliable. See numerous other threads on "herpes diagnosis", "HerpeSelect test", and "IgM" for further discussion. Return to your doctor (or find another one) for proper testing.
Good luck-- HHH, MD