You can have him wear a condom or you could wear a female condom. There is spermicide (lessens chance of spontaneous sex as it does need to be in there for X amount of time beforehand to be effective), birth control pills (you will need to use a condom at least the first month to lessen the risk), the depo shot (though beware that it is rarely tolerated well by most women), a diaphragm (must be specially fitted for you by a doctor and refitted if you gain/lose weight), a cervical cap, etc.
My question is why your husband is asking you to remove that "property" (Are you meaning an IUD?). If you don't want to get pregnant quite yet, you need to tell him that. Tell him having this inside you makes you feel safe from that and that you will have it removed when you feel ready. Tell him if you do remove it before that, you want him to do his part to make sure it doesn't happen before you are ready, whether it's wearing a condom or what. If he's not willing to do anything necessary, then tell him you're not comfortable with having it removed yet.
There are many options from taking birth control pills, foams to injections. Talk to your dr. and he can give you the options that are best for you.