That's hard I mean if you want them in the baby's life then I'd work it out now so there's no stress or tension when the baby comes even know baby's bring people together :) I don't fight with my brother in law he don't speak English and I don't speak Spanish so things work out for me lol :)
Lol sometimes I wish he didn't speak the same language as me but I like knowing what he is saying about me haha
Ignore the brother you are not married to, it makes it look like you are more interested in him than your husband.