Amir and Blind Testing


Let me start by saying I like watching Amir from ASR, so please let’s not get harsh or the thread will be deleted. Many times, Amir has noted that when we’re inserting a new component in our system, our brains go into (to paraphrase) “analytical mode” and we start hearing imaginary improvements. He has reiterated this many times, saying that when he switched to an expensive cable he heard improvements, but when he switched back to the cheap one, he also heard improvements because the brain switches from “music enjoyment mode” to “analytical mode.” Following this logic, which I agree with, wouldn’t blind testing, or any A/B testing be compromised because our brains are always in analytical mode and therefore feeding us inaccurate data? Seems to me you need to relax for a few hours at least and listen to a variety of music before your brain can accurately assess whether something is an actual improvement.  Perhaps A/B testing is a strawman argument, because the human brain is not a spectrum analyzer.  We are too affected by our biases to come up with any valid data.  Maybe. 

chayro

Earlier on this thread I mentioned a couple of the issues that I have with those who base their judgments almost exclusively on measurements, and what I consider to be some limitations of A/B testing as it is typically performed.

But as to Amir and ASR, I think that in many cases his work is both valuable and practical. As a current example, on Friday he tested a "Hi-Res" download recording from PS Audio. He tested both DSD and PCM. What he found, and clearly demonstrated, is that the recording is flawed, and that there were dubious decisions made during the process.

As one who is not well-versed in the intricacies of streaming, I learned some interesting things from his brief video. Beyond that, and this is typically the case, I learned even more by reading the many comments, as they included insights from very sharp, highly experienced people, some of whom are electrical engineers.

Take a look at the thread, and, if you’re in the same boat as me, you will be surprised at what you may learn (e.g. that DSD files are of dubious value!).

PS Audio DSD review

Reading through this I was agreeing with the original question, in that if we are testing gear then we are listening with our brain not heart, so of course everything would sound good. However, @whipsaw then made a great point about a component we went in expecting to like and it not delivering. I wanted and expected to like the Michi X3, I had a great deal available on it, and I couldn’t connect with it. So now I’m back thinking that going in paying attention to how you feel listening to the component rather than listening is likely a better way to test gear. 

Please supply a link to this video review.  I'd enjoy watching it, not least because I've not witnessed Amir bringing his wife in for a hearing experiment - was it an A/B blind test?

Sorry Noske, this was probably about a year ago. Not a regular on their forum and not a big fan. His Matrix borrowed “there is no spoon” mantra and all his psycho babble about expectation bias is in fact a business. He is probably making good money (YouTube + Google) telling people with limited funds what they want to hear: money doesn’t make one happy. The expensive conditioner is a con. Expensive cables are a con. Expensive DACs are a con. Expensive headphones are a con. And so it goes. You don’t actually have to read or watch any of his reviews because you know exactly what his conclusion is going to be. Singxer and Topping are awesome. Audiophile is a synonym for a fool.

If you enjoy this rhetoric do live your life in oblivion (to quote his favourite movie), learn nothing, keep your RME and Singxer with the conviction, no the certainty, that you have the best money can buy. And be happy. If however you ever want to try the red pill, I suggest you actually demo a power plant, a good DAC, a Melco S100. You don’t need an Amir to tell you how to hear and what to think. It’s easy enough to make up your own mind. You just have to have an open mind and be ready to embrace the new.

In my book spoons do exist. Otherwise we would eat like dogs. 

So now I’m back thinking that going in paying attention to how you feel listening to the component rather than listening is likely a better way to test gear. 

And so we are back to square one.  This is exactly what audiophiles often do, and what blind testing is designed to eliminate.

@reven6e Actually it was just a simple request, not an invitation to provide a summary on all the good things about ASR that audiophiles are uncomfortable with.

I'm also not familiar with the whole Matrix/spoon philosophy - do you have links at ASR for that I could have a look at?