Not going to be a problem. Stop now or only use if necessary. I take Tylox for a impenged nerve and was told I could take it during pregnancy but that he would defer to the OB. Talk with you OB, be honest. No one is out to get you. It would be better to know, in case the child was early. The staff would be better prepared for treatment. Call Poison Center 18002221222. They can give you the drug half life.
I agree that it is important to talk to your OB. Always best to be safe rather then sorry. Honestly, your use has been quite minimal, but why chance it? I work in the field of social services, and although there are many factors looked at, if this is the only issue, it's pretty unlikely there would be any repercussions. However, it is extremely important you discuss this directly with your OB. Congrats on your baby and I wish you all the best.