For those of you who are thinking of TTC, but have not officially tried yet, do you ever get scared that you many never become pregnant?

DH says I need to take it easy. I also know that we will never know until we try. Thing is, I have never had a regular period and have polycystic ovaries. To top it all off, I am slightly insulin resistant and have undetermined thyroid issues (the doctors are currently tackling this problem). I didn't know that thyriod issues can be the root of infertility. I know we haven't even started trying, but it just seems like it is going to be an uphill battle.

I agree that I need to take it easy, and I realize that stress plays an important role in all of this. At the same time, I just think it is a little unfair. I don't want a pity party or anything of that sort, but just want to know if anyone else just gets these scared feelings sometimes.