2. tech-talk
  3. 1421262840

In defense of ABX testing

We Audiophiles need to get ourselves out of the stoneage, reject mythology, and say goodbye to superstition. Especially the reviewers, who do us a disservice by endlessly writing articles claiming the latest tweak or gadget revolutionized the sound of their system. Likewise, any reviewer who claims that ABX testing is not applicable to high end audio needs to find a new career path. Like anything, there is a right way and many wrong ways. Hail Science!

Here's an interesting thread on the hydrogenaudio website:

http://www.hydrogenaud.io/forums/index.php?showtopic=108062

This caught my eye in particular:

"The problem with sighted evaluations is very visible in consumer high end audio, where all sorts of very poorly trained listeners claim that they have heard differences that, in technical terms are impossibly small or non existent.

The corresponding problem is that blind tests deal with this problem of false positives very effectively, but can easily produce false negatives."
psag
56 responses Add your response
dopogue
1,773 posts
 
ABX testing is stone-age personified, and Hydrogen Audio is where all the stone-agers gather. I guess I should add "IMO."
zd542
5,339 posts
 
""The problem with sighted evaluations is very visible in consumer high end audio, where all sorts of very poorly trained listeners claim that they have heard differences that, in technical terms are impossibly small or non existent.

The corresponding problem is that blind tests deal with this problem of false positives very effectively, but can easily produce false negatives.""

I have the above quote as being from the thread you mentioned.

"Likewise, any reviewer who claims that ABX testing is not applicable to high end audio needs to find a new career path. Like anything, there is a right way and many wrong ways. Hail Science!"

That one appears to be yours. If not, tell me where it is because I didn't see it.
psag OP
518 posts
 
One more try:
http://www.hydrogenaud.io/forums/index.php?showtopic=108062
If this doesn't work, the thread is titled: Problems with Blind ABX testing - advice needed.
psag OP
518 posts
 
Actually they are not my words. They're from a post on the hydrogenaudio website. I'll try to post the link again:

http://www.hydrogenaud.io/forums/index.php?showtopic=108062.

Anyway, ABX testing has been around forever, and it works. Its used extensively in the recording industry.

Anyone who is willing to invest the time and effort can learn it and use it to compare audio components, digital files, whatever. I've used it mainly to evaluate cables. I was able to replace costly Audioquest cables with a much more cost-effective brand.
geoffkait's avatar
geoffkait
23,365 posts
 
There is no such thing as a test that can be be generalized. Someone else may get entirely different results. Then which test is correct? And who decides?
zd542
5,339 posts
 
Finally, I've been waiting for someone to show us ho to do this the right way.

"Likewise, any reviewer who claims that ABX testing is not applicable to high end audio needs to find a new career path. Like anything, there is a right way and many wrong ways. Hail Science!"

Remember, those are your words. You're stating in no uncertain terms that you, not someone else, but you Psag, know how to do this the right way. Now show us. Up until this point, the only thing people with your view do is talk. That's not science. If you're right, and you really know what you are talking about, pick 2 products, conduct the test, and report your findings in a way so the rest of us can try it for ourselves. That's how a real scientist would do it. No more talk and excuses. Put your money where your mouth is and finally do one of these tests.
Log in to respond
More to discover
80x80
Bricasti M5
80x80
Ayon Audio S-10IIxs
80x80
Focal 36 MONTH FINANCING