My ob proceeded with ivf cycle even though I had a cyst. He said it was not a concern although cysts can make pregnancy painful. However, as Tarobinc said, after a year of trying talk to your ob about running some simple tests just to check that you are ovulating and your tubes are open.
Good luck!
You may want to start charting your bbt so see if you are ov at all. I have PCOS and that is how I found out that I wasn't ov at all and af really was anovulation bleeding, which is not a true period.
I went the IUI route to concieve my baby. I did have cyts, which halted my first attempt but after 2 full IUIs, Sophia was concieved.
So yes, don't give up! Either having an appt, with your GYN or an RE would be the first step (in addition to charting.)
I think it's definitely worth looking into as a possibility as to why you've had difficulty getting pregnant. Ovarian cysts can delay or stop ovulation all together. If I were you, I would look at seeing a Dr, if you are concerned about it. Also, it takes a fully fertile couple up to a year of really trying to get pregnant..so don't give up!