To keep indoor noise levels down, start from the outside and work in. And remember, you might want to be the noisy one some days.
I think we can agree that not all Noise is equal. Birds singing does not equate a gas-powered leaf blower. We may want to let the former in and shut the latter out. Without getting into the weeds about sound acoustics, sound is vibration that can pass through gaps.