Amir and Blind Testing


Let me start by saying I like watching Amir from ASR, so please let’s not get harsh or the thread will be deleted. Many times, Amir has noted that when we’re inserting a new component in our system, our brains go into (to paraphrase) “analytical mode” and we start hearing imaginary improvements. He has reiterated this many times, saying that when he switched to an expensive cable he heard improvements, but when he switched back to the cheap one, he also heard improvements because the brain switches from “music enjoyment mode” to “analytical mode.” Following this logic, which I agree with, wouldn’t blind testing, or any A/B testing be compromised because our brains are always in analytical mode and therefore feeding us inaccurate data? Seems to me you need to relax for a few hours at least and listen to a variety of music before your brain can accurately assess whether something is an actual improvement.  Perhaps A/B testing is a strawman argument, because the human brain is not a spectrum analyzer.  We are too affected by our biases to come up with any valid data.  Maybe. 

chayro

Showing 6 responses by nonoise

Yes, kind of. Placebo is only used when there are two choices to make. Didn't mean to be a stickler, but I'm so tired of hearing that.

All the best,
Nonoise

No, it's not placebo. A placebo effect is short lived, leaving a dead patient. Placebo effect is the lousiest of analogies to use. If someone still enjoys what they're hearing over the long run, it's because it sounds good to them and is the antithesis of the"placebo effect". In fact, it reinforces the view that long term listening is the deciding factor.

All the best,
Nonoise

Hey prof,

No biggie. I wish I could find another link where someone pointed out the differences in the gear Amir uses for testing and what John Atkinson uses. It's multiples of times more expensive and exacting, showing anomalies that Amir's tester can't.

All the best,
Nonoise

ASR is pretty used to empty responses like that one. It basically says "I don’t actually have any good, civil arguments or evidence in response to ASR’s reviews...but since I still don’t like their conclusions...here’s a disparaging meme so I can feel like I got one over on them."

 

Embarrassing enough once. But..3 times?

Posting something like this which is the opposite of what’s in the link, imbues you with what, pray tell? A silly sense of accomplishment?

All the best,
Nonoise

I think this is now the 3rd time I've posted a link to this topic over the past 2 years concerning ASR so here it is again. 

All the best,
Nonoise