I agree with Butterfly38834. It is highly unlikely that fingering you after "wiping" his sperm off with a tissue will cause you to get pregnant. It is medically possible as far as i understand, but extremely unlikely, unless he has super sperm, and you are ultra fertile.
Also, as far as I understand, sometimes, a sudden change in physical activity can cause a shift is body cycles and affect the menstrual cycle. The only way to be safe is to make an appointment with your gynec and get an examination. Better safe than sorry.
Its probably stress deep down from where you thoink there might be a slight maybe that not all of it was wiped off and you think it might be in you. Calm down and just make an appt. with your obgyn, ok.