Babies and Speakers

For those out there with newborns or babies on the way, I ran across a friend who's a fellow audiophile who advised me that after my newborn son arrives in 3 months time that if I plan on getting serious speakers with a decent sub I should consider that I won't be able to run my system volume at pre-baby levels without waking up the child.

Short of buying a nice over the ear headset, which would upset me since I won't be able to run my floorstanding speakers, how big of an issue is this for all of you and what other ways have you worked around it?

Many thanks everyone for making these forums so helpful for an anxious Dad to be.