unfortunately your provider isn't as well versed on the herpes blood tests as they need to be.
Your recent exposure blood tests are the igm blood tests. they are highly inaccurate and also not type specific.
http://www.medhelp.org/posts/STDs/Confusiion-over-other-IgM-Herpes-posts/show/248394 is a terrific former post by HHH on why the herpes igm tests are greatly flawed and shouldn't be used on adults to diagnose newly acquired herpes infections.
The igg blood test is the test result to pay attention to. Hsv1 is incredibly common and even though your 1st blood test was negative for hsv1, not real easy to figure out if you recently contracted hsv1 since then or not. most adults do test + for hsv1 and most who have it don't get obvious cold sores to know it.
At this point your best option is to talk to your ex bf about this. Let him know about your testing issues and ask him if he could get tested and share his results with you so that you can determine if you need additional follow up testing done or not for hsv2. If you parted on terms that make the likelihood of his cooperating ( or would make discussing this a danger to you ), then just scrap that part and repeat your own igg blood testing 3 or 4 months after the last time you had sex with him.
grace