What's going on inside you right next to the baby's ears is louder than a vaccume cleaner. Don't worry about outside noises.
http://answers.yahoo.com/question/index?qid=20080118134641AAmblWD
I was invited to a concert in July, and I was concerned about this same issue. I asked my doctor if it was ok, and she said it was fine.