Simple question: how often, when listening to music, are you distracted by thoughts about the sound of your system -- especially thoughts tinged with dissatisfaction?
If you really are a "pure" music lover, who doesn’t fixate on sonics, congratulations! The "disease", as @ghdprentice calls it, once contracted, can be tricky to manage.
Perhaps it would be helpful to know most of us are located somewhere on a spectrum, being both music- lovers and sound-chasers in varying proportions and that, furthermore, this balance often changes. For example, when I’m happy with the sound of my system, I naturally tend to focus on music. On the other hand, if I’m experiencing problems with my system and listening is yielding little pleasure, I tend to become absorbed by the drive to address sonic dissatisfaction and seek advice. Of course, some of us are more easily taken over by obsession than others. ;o)