I have bilateral ovarian cysts and yes my pains come and go I have many other issues right now but the pain does come and go with me also
My symptoms (for a large benign cyst, which are the same symptoms as for ovca) did not come and go, but rather continued over time and additional symptoms were added as time when on. The symptoms disappeared only after the cyst was removed.
You might have irritable bowel syndrome, lactose intolerance, or possibly even an allergic reaction to milk or the other ingredients of the diet shake if your symptoms cease when you stop drinking the shakes. Anyway, it would not be a bad idea to make an appointment with your doctor to discuss your symptoms.