Yes, The recording needs to sound good for me to like it. :-)
I can tolerate a few issues, however, my patience is has its limits. Especially with anything that gets in the way of an immersive experience.
Does it have to sound good for you to like it?
I listen mainly to classical music. The SQ of classical recordings is all over the place, not nearly as consistent other types of music. Recording large orchestras is a complicated and difficult endeavor. Smaller ensembles are easier to record. So, if you listen to a great performance of an orchestral (or any) recording but have trouble with the sound will you avoid listening to it?