Amir and Blind Testing

I first heard of this web site not that long ago. It was from someone who used a quote from the site… and in my  experience (50 years) this generalization was simply  not true. So I went to the site and read a dozen or more reviews. Sorry, I found the comments and listening observations or recommendations that of no value and generally contradictory to my knowledge. 
 

I have been a scientist for over a decade and worked with hundreds of electrical engineers for decades in high technology… people that make the stuff inside virtually every electronic device you own. I love data: collecting, interpreting and presenting what the data is telling you. I have spent well over a decade doing that, I love the tools, the process and the outcome. But I quickly learned with high end audio this is a great way to lead you away from great sound.  Listening is the only really effective way of evaluating equipment. … although in all honesty he typically measures budget gear. 
 

I hold The Absolute Sound, Stereophile, and HiFi+ in high regards… particularly the first two. I have heard hundreds of components which they have reviewed over the last forty years and the accuracy of there evaluations is really astonishingly good. Not perfect, but very very close. Very trustworthy sources. 

@noske FWIW, I have a great deal of respect for scientists - I double majored in physics and mathematics.  I have no problem with the tests, but I'm glad you like the pictures!

Rigorous testing is always important in technology, where the goal is the production of identical, interchangeable units.  However, we're so far from "perfect sound" that we're still arguing over which imperfections matter and how much.  The first measurement we targeted was flat frequency response.  Nope, we're not there yet.  So what's worse - a broad suck-out of the midrange, or an extremely high-Q resonance above the range of hearing?  What if the HF causes your amp to oscillate?  What if it's at middle C instead?  Is THD better than IM?  What about TIM?

The answers to these kinds of questions depend on the observer and the other components in the system.  Just curious (I've only looked at a couple ASR reviews), but does he have different acceptability criteria for tube vs solid state?  If he measures speakers, what about planars vs. box speakers?  It's pretty easy to set up your testing standard to fail either group pretty much entirely.

As I said, ASR serves a purpose.  If it works for you, that's great!  Clearly, it's not everyone's cup of tea, though.

I prefer reading Stereophile (I'm guessing that Absolute Sound made this transition also when they hired Robert Harley).  They generally do a subjective test and comparison to reference & similar-priced gear, followed by bench testing that includes listening in an attempt to corroborate both the subjective & objective results.  They always let you know when there are differing opinions on a component.  The bad news is that the industry has gotten too big to cover in that depth, which has resulted in perhaps an undue focus on the most expensive gear.

Is this the same Amir that had his former partner make damning accusations before the thread was removed? The one about bad measurements of competitor products to protect his sponsors?

IMO if you have to do an A/B comparison blindfolded and struggle to hear any major differences, then keep what you Have.  If you don't hear an immediate improvement then cross that item off you list.

Happy Listening.

“Science is a bunch of guys in white coats cutting up frogs”. Woody Allen. But just to drag the thread back on topic, I really wasn’t talking about Amir’s measurements or reviews.  I was talking about his comments on the “analytical brain”  vs the “enjoying music” brain and the difficulty these may cause in evaluating components.