I think the best thing you can do if he's bothering you that much is avoid him like the plague. If you see him walking towards you, leave the room. Don't say anything, just walk away.
You see, he gets a power trip over knowing how much he can get to you. The more you react the more power he sees that he has so of course he's enjoying this immensely!You must stop allowing him to get a rise out of you. Ignore him. Pretend like he's not even there. Put some earphones in your ears and walk around listening to music or something. Don't react! If you can do this he will eventually stop because he'll see that he can't get a rise out of you anymore. I promise this will work if you will stick with it. It may take time because he may just try harder at first if he sees it's not working anymore. But if you stay consistent and ignore him and don't let him get to you he will stop! I promise!
He really only has the power over you that you give him. You are the one in control over your own emotions and how you react to or handle things. Only you. Remember that.