I would say that the listener's choice of speaker and other components may be comparable to the choice of where in a concert hall the listener sits/where the microphones are placed.
Not at all ...
You forgot that all components and the speakers sound such and such in SPECIFIC room acoustic conditions... ( acoustic material content, geometry, size, treatments and acoustic devices etc no room sound the same at all and serve speskers in the same way )
And you forgot how the electronic design gear choices will modify the sound...
Of course, the more neutral the listening room/speaker interface, the closer the system will be to reproducing
No room is neutral... And no speakers sound the same if we change room parameters... Neutral is a relative convenient word we use for specific ears/brain experience of ONE owner... It will not be neutral on the same level for another users even in the same room ...