I find yoga really helpful, its relaxing and stretches all the right places. Ever since I started it, my back pain has nearly gone away! Pilates is another great exercise for reducing back pain... I wouldn't do weights at the gym unless you really know what you're doing...
Swimming is great. You could try Prenatal yoga, tai chi, walking. Good luck