Diminished Ovarian Reserve Second Pregnancy?

I am 31 years old and had my first child 6 months ago. I had been trying to conceive for 3 years before I got pregnant. I have diminished ovarian reserve, with an FSH that has been as high as 14.5. I did 2 months of clomid, 7 months of follistim with IUI's and 2 IVF cycles, but did not get pregnant. I got pregnant on my month off meds while preparing to fly across the country for my 3rd IVF cycle. I  took DHEA 25mcg twice daily for 2 months before I got pregnant.

Now that I've had the baby, we've been trying to conceive for the past 5 months. My infertility doctor does not think I should go back on all the meds (follistim, etc) b/c they didn't get me pregnant the first time. He thinks this baby was a lot of luck and he is not optimistic that I will have another child.

I know this is a strange case, but I was wondering if there are any other women out there with diminished ovarian reserve who have been able to have more than one child.