do blind tests have any practical significance


do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis

Showing 5 responses by mrtennis

i have been thinking about this question for a while.

i had forgotten that i initiated this thread, months ago.

i think the important question is: does one prefer component "a" over component "b".

an interesting answer to this question would be to perform 2 tests. the first test would consist of comparing the components without being aware of the brand names. the second test would be identical, except that the names of the components would be revealed prior to the comparison. presumably, several months would elapse between the 2 tests.

the conditions of the test, such as sources, duration of exposure, manner of substituting one component for another, etc., could be determined by a committee of "wise men".

the question is, is there a placebo or "mind over matter" or prejudgment effect of being told what components are being compared , such that the results of the tests would be different ?
i think the purpose of the thread is to suggest the advantage of evaluating the sound of a component in absence of any attitudes about the component before the audition.

one does not literally have to be in a dark room or wear a blindfold. i think it is sufficient to be sighted so long as the brand and model of the component is not known.

unbiased assessment reduces the likelihood of erroneus judgments.
a blindfold is irrelevant. the purpose of a blind test is to ensure that a listener is unaware of the component auditioned. if one sees the component and it has a generic look and does not exhibit any visual cues to identify the product, the listener will be totally ignorant of the manufacturer as well as any other information about the product. blind should be interpreted in the figurative sense, rather than literally.
a reviewer should be objective when appraising the sonic merits of a component. a reviewer should be an accurate reporter of what he/she hears--no more no less.

it is counter productive for the reviewer to express a sentiment about the component reviewed. just report the facts and leave the biases and persuasion out of the review.
hi nrchy:

personal anecdotes are ancillary to the review. all of the preliminary repartee has no bearing on the review.

in some of my articles, i use poetry and engage in expostulary philosophical remarks. my reviews are dsiapassionate. i try not to influence the reader.

you may read my reviews on audiophilia.com . currently you can peruse a write-up of the 2007 ces show.