You can have 250 mg of caffeine a day.
Indulging a little is okay. I was caffeine free until after 20 weeks then I went a little crazy and drank too much because I didn't have it in moderation when I was craving it. Doctor said that's just fine. I'm now 32 weeks and perfectly healthy. I enjoy a coffee drink or tea from time to time, just not in excess.