This is a good question! I drank hot tea yesterday and kind of been hurting since!
If your around a 'natural/organic' (I call them hippie stores lol, not negatively love those stores) stop in there or spend an hr or so looking up herbs you need to stay away from most teas are of but the last thing you need is to drink something that could hurt you.
If it is just black or green tea with natural peach flavor, it's fine. There are many herbs that are great for pregnancy and many you double avoid. Read the ingredients and see what is in it. There are a ton of websites with info on what to avoid.
Check the ingredients first and make sure it doesn't contain anything that's on a do not consume list. I know rose hips you need to stay away from.