Amir and Blind Testing


Let me start by saying I like watching Amir from ASR, so please let’s not get harsh or the thread will be deleted. Many times, Amir has noted that when we’re inserting a new component in our system, our brains go into (to paraphrase) “analytical mode” and we start hearing imaginary improvements. He has reiterated this many times, saying that when he switched to an expensive cable he heard improvements, but when he switched back to the cheap one, he also heard improvements because the brain switches from “music enjoyment mode” to “analytical mode.” Following this logic, which I agree with, wouldn’t blind testing, or any A/B testing be compromised because our brains are always in analytical mode and therefore feeding us inaccurate data? Seems to me you need to relax for a few hours at least and listen to a variety of music before your brain can accurately assess whether something is an actual improvement.  Perhaps A/B testing is a strawman argument, because the human brain is not a spectrum analyzer.  We are too affected by our biases to come up with any valid data.  Maybe. 

chayro

Showing 1 response by onhwy61

The analytical mind isn't binary.  It's not on vs. off, but more a matter of degrees.  Sometimes the mind, regardless of listening mode, has a clearly formed opinion and other times things are kind of opaque.  All of which leads me to believe that most "upgrades" are subtle.

If it takes you months to make an evaluation, then I think it's just as much a reflection of your mind and body's movement over time than the actual change in your system.  Your weight, blood pressure, eating habits, sleep patterns, sexual activity, exercise, drug usage (both medicinal and recreational), illness, etc. all have a direct bearing upon what you think and how you feel about the sound of music.

Does the system change make a difference?  Do you like the difference?  The words of the poet illuminate:

First there is a mountain, then there is no mountain, then there is.