do blind tests have any practical significance


do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis

Showing 6 responses by nrchy

So should magazines hire writers who have no preconceived notions about a product? Do you want to read a review written by someone who does indeed live in a vacuum???

How can someone without years of listening experience write a review??? You have sunk below the level of absurd...

:o
Mrtennis has been arguing about this for a while on the Stereophile website. I guess it's migrating...
I lied about MrTennis, he's not the one who has been posting on stereophile. Sorry Mr T.

Double blind testing is a great way to determine a listeners ability to hear, but that is about all. It's not a good way to determine the value of a product.

Who buys gear based on DBT????????????????
Not having been to Sue Kraft's new house I can't state it with absolute certainty, but I'm pretty sure she does not live is a vacuum!

Sue has been an audiophile for longer than I have, and has owned and auditioned a lot more equipment than most people on AudiogoN. Should she not have an idea what to expect when she auditions a pair of amps from a company that has been around for a long time and has a well established reputation. I don't know if Susie liked the amps or not, I would guess she isn't selling her currrent system to buy them! BUT that's not the issue.

Who goes shopping, or auditioning without a good idea of what they are getting into? That person would be foolish! At that point in the process a person should have a good idea of what to expect.

The blindfold is not the issue, you are questioning the integrity of the reviewer! If you want to play that game, you are certainly welcome but don't cloak it under the mantle of objectivity. Either something sounds good, or it doesn't, it doesn't matter what headgear is involved...

:o
I don't think you understand the process involved in working for a magazine, or reviewing a piece of gear...

The reviewer lives alone, and has to take possession of the amps, get them into place, hook them up, andthen conduct a review. It is impossible for her not to know what is being reviewed. Reviewers don't go off to some magic island named vacuum and sit there for a few weeks to do their job. This is a part-time, supposedly fun (if you call getting reamed out by every audiophile who disagrees, fun) job for people who are otherwise gainfully employed.

You're right, it doesn't make any sense...

:o
As a tube guy I don't think you would be welcome on the magic island of Vacuum, you're living in the past!!! : )

MrTennis, People want reviews to be inviting, and so reviewers offer personnal anecdotes to pull the reader in, this is all IMNSHO Ms Kraft did in her review. I could be wrong, since I have not read the review, but I think the attacks on the writer are unwarranted. No one knows the experience or intention of the writer except the writer. To subject her to your prejudices is the worst type of STEREOtype... and to remove all value from this or any other review.

:o