You really should make an appt with your gyno and have them run a cd3 bloodwork panel. That will really help clear things up for you. I am 42 and was very worried about it, needless to say. It turns out my FSH is still really good at 7. You may be worrying for nothing.
Are you still having regular periods? I am 44 and trying for my 2nd. I have regular cycles and have not had any tests to check, egg vitality,quantity, hormones, etc..Although I did have a complete bloodtest done, and an internal exam, just to get the greenlight! Just go for it!
I am 39 and had perimenopausal symptoms, too, as well as an FSH of 15. I got pregnant naturally and easily. Don't let the doctors scare you. I'd keep trying a couple more months -- but without any stress: I think no stress is the key to my pregnancy (I thought I couldn't have kids so I had given up) and to others I know.
Good luck!
PS My pregnancy is my first, which is supposedly even harder than the second.