It just means ur hormones are going up and down. Hormones are responsible for metabolic responses so not to worry. Ull gain plenty before its over!
If the doctor is not worried then neither should you, my entire pregnancy I lost a total of 22 pounds gained 5 and this past week lost one pound. Im currently 37 weeks +6 days