Personally, I know there is real sonic tradeoff for doubling a listening space as a living space. However, I am a big fan of being able to use and appreciate my system as much as possible and with people when possible.
I could never imagine having a listening room where I'd sequester myself in order to listen. There is a huge sonic advantage for a dedicated space, though.