FWIW, I have my stereo system in a room 2 walls and 12 feet away from my large office. My system is on all day to FM or a multi play CDP. I thoroughly enjoy my music in the office. Then I go into my music room and sit down in the 'sweet spot' and get all the 'audiophile addict' tendencies which I have sort of trained myself not to be absorbed by. That sweet spot and the focus on soundstaging can be the real killer of the 'music'. In a perfect world listening off axis and in mono would be the preferred methodology, and you could fill your room with the 'sound of music'. :-)
Let the best be your guide
All of us have had to come to grips with bad sounding recordings. They can be disabling and make you question your whole system. The trick is to accept them for what they are and not to generalize. I try to listen for the music and skim over the imperfections. When confronted with a clinker, to save my sanity, I play a recording i know to be superior sounding. That restores my faith in the system and brings me back to reality.