With over 100 posts it’s time I give my perspective. To answer your question(OP) NO, but many factors can dispute this since a plethora of recorded music has both great content and SQ. For many that own physical media the SQ of a recording should have equal importance since were using more of our time/money/effort and physical space as opposed to those that mainly stream(sample) music. As previously stated if one has a very wide taste in music genres the SQ issue is not as significant. Being selective regarding a recordings SQ does not diminish the admiration one has for the music.
Does it have to sound good for you to like it?
I listen mainly to classical music. The SQ of classical recordings is all over the place, not nearly as consistent other types of music. Recording large orchestras is a complicated and difficult endeavor. Smaller ensembles are easier to record. So, if you listen to a great performance of an orchestral (or any) recording but have trouble with the sound will you avoid listening to it?