You don't need to use a condom when you are taking the pill. Although, the pill is not 100% effective, just as well as the other birth control methods. There is a high chance that you do not get pregnant while taking the pill correctly, it's close to 95%. Some of us still get paranoid about it when not using condoms, I know exactly how it feels!
If it makes you feel better, start using condoms or just ask him not to ejaculate inside you.