You are actually underweight at 101; 97 would put you even more so and it's only a difference of 4 pounds.
I checked a height/weight chart and here's what I found for your height -- of course, your age also has something to do with it, but this chart does not consider age.
Height Small Frame Medium Frame Large Frame
5'2" 108-121 118-132 128-143
I would not advise you losing any weight, since you are already underweight.