I did same thing. Ive found great buys at garage sales/online sites, thrift stores. Couponing & watch for sales on baby items!
Craigslist is a big help. People give out free stuff and cheap if not free. U should go to local churches they always have stuff like diapers. Wipes. And even gentle used cribs. Also find the nearest crisis pregnancy center . They give lots of stuff.
I am 37 my youngest is 12 ... thankfully my sister has a 2 yr old son so I got her extras ...but honestly we are also having a green baby shower which is where your friends/co-workers who have children with baby stuff they no longer use can feel free to donate it to you ... the only thing I have bought is diapers and I buy our store brand (Kroger-comforts)...I love them and I have used the coupon system well...lol if you yourself buy diapers start with size two most people who buy diapers for baby showers buy newborn...you don't want too many of those they stay in size 2-3 the longest...good luck
Also look up groups like freecycle.com. I got my papsan swing and my glider there.
We just did the same thing. Our youngest is 9. I got my crib, changing table, swing, bouncy chair all off of Craigslist. We did buy our car seat and stroller brand new but just waited until the one we wanted was on sale. I started stocking up on diapers and wipes early on but only bought them when they were on sale and I had a coupon (two coupons if buying from Target-1 manufacturer & 1 store coupon).