Blind Listening Tests?


I would like help locating any articles or studies on the subject of blind listening tests as it relates to high end audio equipment. I realize this is akin to blasphemy for many who are into this hobby, however, the more times I read of people claiming to hear audible differences between certain components and system set-ups, the more skeptical I become.(e.g. equipment racks ,interconnects,etc.)The fact that virtually every major audio publication is so adamently against the idea only adds to my skepticism.

Before I invoke the wrath of this site's faithful, let me clarify that I am not doubting the sincerity of those who claim to hear sonic differences between certain components. However, believing that an audible difference exists when one knows that he is listening to a piece of equipment that is generally well regarded or made by a well respected manufacturer is entirely different from being able to detect the difference in a blind listening scenario. Given the undisputed connection between the mind and our perceptions, why is there so much sentiment against such tests? Couldn't the results of such testing be simply another piece of information that we could factor in to our purchasing decisions. It seems to me that those who are so sure of ther critical listening ability (i.e. all stereophile reviewers) should not hesitate to prove their skills.

I look forward to any help in directing me to more information on the subject.Thanks, Don.
dtittle

Showing 5 responses by 70242241e18c

Jadem6: Your imagination is running amok. I never said there could never be any difference in performance between pieces of audio gear.

Detlof: You're right, I'm no drummer. I'd be the engineer in the control room. ;)
Good switching will not affect the sound quality. That can be tested for by doing a double-blind test on the ABX switcher itself, by swapping it with straight wire to see if the listener can distinguish the difference.
Jostler3, the ABX page is no longer on the URL you cited. It's here: http://www.oakland.edu/~djcarlst/abx.htm

It's got very good documentation of the double-blind test process and explanations of the statistical analysis involved in evaluating the results.

Also, in a white paper by Dr. Floyd Toole there's a description of tests where the listeners were allowed to see the speakers they were evaluating and tests where they were not; not surprisingly, in the "non-blind" tests they gave higher marks to the speaker systems that looked more attractive. The white paper is at http://www.harman.com/wp/pdf/AudioScience.pdf.

I like double blind tests. It's fun to take them and to witness others taking them. Especially when there's an "everybody knows a Goldbrick M9000 sounds better than a Conethumper Gizmotron" type of comparison being made. Well, after the test, maybe everybody doesn't know that now. Or maybe a listener will hear audible differences between A and B and find that the one that sounds better actually isn't the one they assumed was superior.

I believe in getting value for what I spend on audio gear. If something commands a premium price, it ought to offer comparable audible benefits. And I stress again, audible. If not, keep it, because I'm not interested in impressing people with how much I can spend. I just want great sound.
Bob_bundus: Double-blind testing is useful only if you want to know what is truly audible. If your main interest is nameplates, model numbers, and prices, it's not useful because it might at times show a non-existant or even inverse relationship between price and performance. But rest assured, if you fear ever having to judge audio gear solely on how it sounds and not on knowing or being told beforehand what you're listening to, there's little chance you'll ever be put to that test.

But this controversy reminds me of this joke: The drummer stepped outside before the recording session and was surprised to see the guitar player outside already, but sobbing. "What's wrong?" the drummer asked. "Here we've got this important session to play, and the bass player detuned one of my strings!" the weeping guitarist answered. The drummer then asked, "So why don't you just tune it up again?" Protested the guitarist, "But he won't tell me which string it was!"