My own take is that you must qualify any judgement on the relative merits of two loudspeakers with "in that room" (first and foremost) and (to a lesser extent) "in that system". Per Al, the latter can largely be controlled for, but often it is not. Beyond the potential amp/speaker mismatch, there is also possible variation in the source - particularly if it's vinyl. I have two turntables/arms/carts in my system and they do sound different.
Per Viridian's comment, I agree 100% - the room is the thing. Ignoring this factor leads to several complications in the task of judging a loudspeaker. Beyond the blanket judgements based on A/B comparisons that you might see in these forums, there is also the matter of published loudspeaker specifications (which often use anechoic measurements to hold the room "constant").
However, the use of published anechoic Frequency Response charts to demonstrate a speaker's superior "accuracy" is - IMO - both misleading and counterproductive. I'm gonna guess that your room is not an anechoic chamber. If you ever compare any of those published anechoic graphs with your own in-room measurements, you'll quickly see just how much they diverge. IME, below app 150hz, you're hearing the room as much as (or more than) you're hearing the speaker.
So, IMO you can't pass universal judgement on the relative merits of two loudspeakers from an A/B comparison in a single room. Nor can you judge the relative merits when you hold the room constant with anechoic standards.
IMO, every A/B should be qualified for the room.
Marty
Per Viridian's comment, I agree 100% - the room is the thing. Ignoring this factor leads to several complications in the task of judging a loudspeaker. Beyond the blanket judgements based on A/B comparisons that you might see in these forums, there is also the matter of published loudspeaker specifications (which often use anechoic measurements to hold the room "constant").
However, the use of published anechoic Frequency Response charts to demonstrate a speaker's superior "accuracy" is - IMO - both misleading and counterproductive. I'm gonna guess that your room is not an anechoic chamber. If you ever compare any of those published anechoic graphs with your own in-room measurements, you'll quickly see just how much they diverge. IME, below app 150hz, you're hearing the room as much as (or more than) you're hearing the speaker.
So, IMO you can't pass universal judgement on the relative merits of two loudspeakers from an A/B comparison in a single room. Nor can you judge the relative merits when you hold the room constant with anechoic standards.
IMO, every A/B should be qualified for the room.
Marty