Blind Testing is Dead - Long live My Wallet testing.


Hi Everyone,

I was seeing some discussions around cables, and reading other discussions about A'gon members asking for opinions on different alternatives for hooking up a DAC, or TV sound, or whatever, and it made me think of this.


I want to tie a few things together:

  • Most technical measurements consumers read were defined by the 1970s. It is fair to describe them as stagnant.
  • The cost to benefit ratio of a lot of products can vary a great deal.
  • I hear things I can't yet measure in cables and crossover components.
  • I like measurements. 
  • Someday measurements commonly discussed among consumers will improve and better tie our values to technology.

A lot has been made about double blind testing, and a lot of readers rely on taste masters (web sites, magazines and social media) and whether in fact these taste masters can hear anything at all. Reminds me a lot of blind testing of wines, or an article I read recently about how much super rare whiskey is fake.


When deciding on a bit of kit, I could not care less about double blind testing. I care about :

  • What audible value can I perceive?
  • Is the price proportional to that value?
  • Is my money better spent on a vacation or liquor?

We should also note that I'm a bit of an iconoclast. Most consumers also care about:

  • Brand recognition
  • Style
  • Perception of modernity (is it cutting edge no one else has)
  • Perception of construction (how much does it weigh, how is it packaged)
  • Ability to create envy.
  • Price ( if it's too inexpensive, it can't be good! )


What is my message then? My message is that this is all cute, like reading about movies or books or music shows, but in the end, it's my wallet, no one else's. John Atkinson is not buying my speakers for me. I am. My hard work creates value which I use some of (sometimes too much) to buy audio related products. The more you detach yourself from brands, costs and worries about measurements the more frugal, and happier  you will be.


Best,

Erik


erik_squires
That is very well said Erik we each have our own sense of value and our own ears.  We are far better off when we make decisions based on our own listening and the gear that makes us most happy.
Erik,

I agree with following statement, 

“The more you detach yourself from brands, costs and worries about measurements the more frugal, and happier you will be”. 

I took a chance on reletively unknown brand late last year and couldn’t be any happier. The mono amps continues to amaze me each day as they are close to being fully broken-in. 

Eric: It seems like you’re trying to breathe new life into these old controversies.  I’ll click.  My guess is that the Audiogon forum readers are securely in their respective corners.

Developers still use double blind testing.  IMO DB testing is too difficult for consumers and is suicidal for reviewers. 

I see you contribute to DIYaudio on occasion.  There was a developer over there lamenting the daunting task of displacing a perennial speaker favorite from the DB winners circle.  (I assumed it was a competitor’s product.)

I still read the measurements JA posts on speakers.  A speaker with a frequency response rising from 10K to 20K is something I would avoid - no need to waste time there.   

There are a number of audio products that either left the engineering domain a while back (luxury electronics) or were never in it to begin with (tweaks).   Measurements are irrelevant to these guys and their customers.

I agree that we all decide with our ears and our wallet (although some seek validation on various forums.)  

Mike


I hope I'm not breathing new life into old arguments.


My intention was to bring a synthesis of competing ideas together into one that makes us happier, and reduces cognitive dissonance. :)
Post removed