do blind tests have any practical significance


do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis

Showing 1 response by dbphd

MrTennis,

I'm surprised by your question and your assertions.

You should know that forced choice tests are the only scientifically valid kind of tests, even though it may be impractical for evaluating audio equipment. If you can't reliably distinguish among two or more conditions (amps, power cords, or whatever), I have no interest in hearing your subjective chat about how superior one is over another. But high-end audio is so full of mysticism the last thing that is wanted is objective evaluation. The emperor may in fact have no clothes.

So, yes, blind tests can be useful, but difficult to implement. I suspect most manufacturers do such testing to evaluate proposed improvements in their own products and to compare their products with a competitor's. I've certainly spent my time in labs doing blind listening tests -- worst of all is testing in a deep LF anechoic chamber, very uncomfortable feeling.

db