I do know “audiophiles” who only listen to a same small set of tracks.
I am always looking for new music.
Returning to familiar/favorite music when new gear pops in.
Always great when new gear brings out new details in favorite music.
"audiophiles listen to their equipment"
That quote is misattributed to Alan Parsons, as I understand. Anyway saying there's a problem with wanting good sound is like saying an instrument designer, aiming for beautiful sound, could not possibly be a music lover and is only interested in the sound of the instruments. I.e. the sound is inseparable from the music. For me the beauty of the sound, good microdynamics, and so on, are the "doors" to the meaning of the music.