Infection of the heart valves is called endocarditis and the symptoms are extremely variable-- often people have fever and don't have any other reason to have it. I would suggest seeing your physician as soon as possible to have this more fully evaluated.
Even after taking the antibiotics you could still have endocarditis-- it takes many weeks of therapy to clear valve infections and sometimes surgery if the lesions are big enough.