The Audio Science Review (ASR) approach to reviewing wines.

@analog_aficionado this seems like the most complete explanation of the disparity between certain audiophile communities and ASR.  I'll try to enhance your points without reiterating too much.

Measurements have their place.  The measurements aren't the problem with ASR.  the problem is the mob of people that pounce anyone that says "hey this is better even though it measures poorer"

As if someone could hear the difference between -120 THD and -110.  I agree that at this point, most of these numbers are meaningless as we are well below the 1% THD threshold.  Which is another funny point in all this.  ASR claims to say "you can't tell the difference between amps and cables" based on studies done over 50 years ago, and yet will quibble over -100 Sinad vs -120.  It seems completely absurd to me to both say you're WITH the science, and at the same time be quibbling over measurements that should have NO audible effect based on the "science"

And I have a problem with him listening to the speakers, but not any other equipment because "it all sounds the same" - then what is the point of measuring all of this junk????

After hearing things that they don't measure make a truly substantial differences in my system (Shunyata power conditioning and cabling, proper speaker cabling), I realize that I can only use them for measurements and for feature set breakdowns, NOT for choosing my equipment.

The sad thing is, the "happy panther" scale always rewards the highest measuring equipment because of the horde of stat hunters that are ready to say it's better without hearing any of it.

It's sad really.  These guys are all audio lovers but are sitting there with their $500 topping DACs and amplifiers, running their kefs, with amazon basics wiring thinking they have the best system money can buy.  I used to be angry about it but now I just feel sorry for them.  Sorry that they probably will never experience what a true hi-fi system can do to a person.  Great discussion here, OP

@hilde45 valid point.  Measurements are for showing what's measured (duh).  This can be invaluable when trying to match equipment to the room.  But yes, at the end of the day, our ears have to like the results.  I'm happy ASR exists for the purpose of looking at the objective measurements.  I'm unhappy that they are most likely steering newer audiophiles down the measurement rabbit hole, when they don't even have a clue yet what type of speakers and equipment they personally enjoy. 

@oberoniaomnia "So the burden or proof is with those who think there is a difference" 

There should be no "burden of proof" in these matters.  The burden of proof is for the individual to decide.  Not for us to prove to the rest of the community what we can clearly hear.

Luckily for us that can hear the differences, we have gone beyond standard testing and used our own ears to decide what we can hear.  Shocking really!  And when these differences can be repeated numerous times and we hear the same difference when gear is changed.  And when even non "audiophile" friends and family can admit they hear a marked difference when it comes to cabling, power conditioning and amplification, then clearly we don't need empirical data to tell us there is a difference. 

The "burden of proof" is on the engineer to use their technical knowledge to create a product that creates a value added proposition to the end user.  The only burden of proof we need is with our own ears.  

But the reason why we call out establishments like ASR is because some people take their opinion and measurements as reality and as the sole place to make decisions regarding their gear.  When in fact, it is far from the entire understanding of what is happening in an audio system.  Valuable information?  Yes.  Contains every variable to help you decide the right gear for you?  No

To be fair I still can't tell much of a difference in interconnects...

This thread cannot die.  It has been so utterly entertaining

@samureyex @knownothing thanks for posting my exact thoughts.  Making it super easy for me over here