Since you say you are diabetic, do you test your blood sugar when this happens? It is very likely that your exercise is making your blood sugar go low.
you have to be careful with that, you should go see your doctor and explain the feeling to him. Also its common to an extent for your heart to beat fast when your walking, if in a sense your working out, ya know?