I wouldn't necessarily be worried. It can be from doing to much or something else. I had it a little too. I know I got it from lifting stuff that was heavy
I been having brown discharge since my pregnancy, but not everyday. My doc said it's normal. Im in my 2nd tri too.