DBT: Audio Industry's "Mortal Enemy?"


Personal opinions on "Double blind test". Is it THE ONLY, true scientific way on comparing the components? You be the judge!
eldragon
No, having done quite a bit of research in the field of psychology I can tell you that the majority of research is not double blind, at least in my field. I am kind of amused when some of the guys take it as the only method of experimentation. Placebo effect is very real. But it does not explain how for example when you expect that budget cd player to sound worse than your higher priced model, it actually sounds better. Placebo is about expectation and double blind test are designed to eliminate the power of suggestion or expectation. Of course when you have statistically valid results that have been obtained throught double blind test they can be more reliable indications of what the data is actually "saying." ButI am reminded of when I was an undergrad and took part in some studies for extra credit. The experiment was simple. I was given a set of about 20 small weights and then asked to pick them up and judge whether or not the one I was currently holding was heavier or lighter than the previous one. At first it was easy, but after 15 minutes of this I became so fatigued that I could not tell or did not care which was heavier or lighter. I think that properly designed test are very useful. The problem is it does not seem to me that many of the test I have seen were performed by people who have done enough experimentation to administer such measures of human perception. The audio industry does not seem motivated and those people with the knowledge seem to have more pressing things to test than amplifers or interconnects. So even though I understand the scientific method, I trust my own ears.
Bulldogger; interesting, well written, and well reasoned post. I have nothing against blind testing as long as it is designed to be statistically meaningful-- can you imagine trying to come up with a control group?. But it seems to me it's especially tough to implement in audio because of the "time" and "relaxation" elements. Cheers. Craig.
This type of testing is valid.The audio press will not ever be caught dead in this type of test.It would expose them.
I think Eldragon is correct. The double blind methodology is the scientific way to test for differences. However, listening to music is not scientifically testable. If you want to test for differences in sound, then the double blind can be most appropriate and useful. It's been my experience that expectations strongly influence my initial reaction to a product. A double blind test can eliminate this phonomena. Yet at the same time, I strongly doubt that a product designed purely via double blind methods would really capture the magic of music. Science can take us only so far. The essence of music requires a suspension of disbelief.
Good points all. And I'll add the most obvious one to it: One man's trash is another man's treasure. Last night, I was at a friend's house listening to his system. He has taken the route of a more neutral sounding system (ala Sonic Frontiers and PSP. I, on the other hand, have become accustomed to a more euphonic sound (ala CJ and Vandersteen). I thought that his system was harsh. He would probably think that mine was like listening to music with cotton in the ears. It's a difference of taste and we are both correct and will continue to enjoy our respective systems.