It might just add stress and ruin the moment for you. Plus, they can come as soon as baby has arrived.
For me my in laws wouldn't even want to be in the same building let alone room (they're scared of babies so avoid us at all costs with a newborn lol). This time around if I go into labour during the day then my mum will come over to take my little one to the park while I give birth (expected to be under an hour) and then when they come home there'll be a baby to greet him! We just want it to be our special moment together as it's likely that we won't have anymore. If it's at night then my little boy will wake up to a new baby brother or sister in the morning, my mum will come over so that she is on stand by if I need to go into hospital so she can be in the house with our son but it's unlikely she'll be in the room unless the midwife doesn't make it in time!
Every labor/delivery is different. In my opinion I would keep it between you and your husband, but that's just what I would do bc you never know what could happen! It's nice your first delivery was good, praying for another one for you:) bottom line, do what you want and makes you feel happy!