Audio Science Review = "The better the measurement, the better the sound" philosophy


"Audiophiles are Snobs"  Youtube features an idiot!  He states, with no equivocation,  that $5,000 and $10,000 speakers sound equally good and a $500 and $5,000 integrated amp sound equally good.  He is either deaf or a liar or both! 

There is a site filled with posters like him called Audio Science Review.  If a reasonable person posts, they immediately tear him down, using selected words and/or sentences from the reasonable poster as100% proof that the audiophile is dumb and stupid with his money. They also occasionally state that the high end audio equipment/cable/tweak sellers are criminals who commit fraud on the public.  They often state that if something scientifically measures better, then it sounds better.   They give no credence to unmeasurable sound factors like PRAT and Ambiance.   Some of the posters music choices range from rap to hip hop and anything pop oriented created in the past from 1995.  

Have any of audiogon (or any other reasonable audio forum site) posters encountered this horrible group of miscreants?  

fleschler

I vaguely recall @juanmanuelfangioii posting at ASR but I may be misremembering as the account isn’t findable (although possibly deleted). It’s a memorable user name though. YouTube or Darko or somewhere else perhaps. I’ve asked what was ban-worthy in my posts here but received no answer. I doubt there’s a conversation to be had.

@laoman unfortunately I have also observed the behaviours you describe from ASR’s founder, I’ve even discussed directly, as noted above. I just think it’s a mistake to carry on like that, a bit of humility and willingness to consider others goes a long way.

What happened to the post about the cage full of squawking parrots?That almost compensated for the whole ASR experience!

@prof 

 

You seem very reasonable. Read @laoman  's posts and tell me if I am off base.

 

@laoman all you have done is thrown insults. Amir was rather cordial when he first came on this topic. Neither he nor anyone should have to put up with the lies and abuse that you and others delivered. You twisted his words. You claimed he said things he did not. You called him a liar without justification.

 

@laoman you also made made a snarky comment about my wine knowledge based on a post I wrote but have not in any way shown what I wrote was incorrect. You made a similar comment about my audio knowledge, though I have never claimed to be an expert, yet you have provided no support that anything I have said is incorrect.  If this is how you behave why would you expect respectful behavior from others?

For the record @laoman , in my first post I commented that I found the ASR mood at time toxic. However I don't see the blatant repeated lies masquerading as arguments I see in this topic.

 

I am in no position of authority to question Amir's testing methods other than wrt general scientific rigor. I know you are certainly not in a position to question his methods. I would hazard a guess that the members of ASR are far far more qualified to question his methods than people here. Far more. There are threads on test methods on ASR and what could be improved. However, complain as you will, many manufacturers respect his results. With all the qualified people that participate in ASR, and accept the results, it is arrogance on your unqualified part to be sniping about his methods.

The problem I have is people telling me what I can not hear. If I hear differences in cables, I want to learn what is happening. If other people tell me that it is impossible and I am delusional, I find that not the right attitude for investigating the parameters for what is causing that effect. (geometry, dielectrics, purity, etc...). 

Good scientists push the envelope, share knowledge and are humble. Measuring things is just measuring. Nothing more, nothing less. Measuring is not a sacred, end to all discussions, type of knowledge.

Post removed 

"With all the qualified people that participate in ASR, and accept the results, it is arrogance on your unqualified part to be sniping about his methods"

Normally I do not answer trolls, however.

1) Failure to understand Klippel measurements

2) Poor testing methodology - eg the tests conducted on the Chord M Scaler

3) Failure to read user manuals about tolerances before engaging in testing

4) Testing cables for interference when they are not plugged in to anything

5) Not checking if the samples sent are "cherry picked"

6) A refusal to take responsibility for recommendations when the product quality is not satisfactory eg Topping.

7) Conducting speaker listening tests based on 1 speaker only ( I do not care what he says about the validity of this, as this is nonsense)

8) Reliance on Sinad rather than use industry standard "THD" and "S/N ratio when this an old and arguably inefficient method of measurement.

9) Listening at ridiculously high volumes eg on the Focal Clear headphones at 115 db. Are you serious??

10) The farcical review of HiFiMan Ananda headphones where he was simply way off beam.

Do you want more, because there is plenty more. By the way

 

1) Failure to understand Klippel measurements

Are you referring to Danny Ritchie claiming this? It took 5 minutes to find engineers taking apart Danny for his lack of knowledge of how Klippel works.  If you mean his Magnepan test I cannot comment and neither has Magnepan.

 

2) Poor testing methodology - eg the tests conducted on the Chord M Scaler

Poor how? The unit does not so anything when connected to a half decent DAC. It's output is very jittery.

 

3) Failure to read user manuals about tolerances before engaging in testing

Tolerances of what? You are really reaching here.

 

4) Testing cables for interference when they are not plugged in to anything

 

Took me a bit longer to understand this, but your comment is false. He tested unconnected to examine shielding and then connected it.

 

5) Not checking if the samples sent are "cherry picked"

In this topic Amir stated that most of what he tests comes from listeners.

 

6) A refusal to take responsibility for recommendations when the product quality is not satisfactory eg Topping.

 

You have both made up a failure rate for topping and no review site does. This is a ludicrous attempt to discredit.

 

7) Conducting speaker listening tests based on 1 speaker only ( I do not care what he says about the validity of this, as this is nonsense)

 

It is not that you don't care it is that you are not qualified to make this comment. I read the paper posted. Makes total sense.

 

8) Reliance on Sinad rather than use industry standard "THD" and "S/N ratio when this an old and arguably inefficient method of measurement.

 

Flat out incorrect. Have you even read any review on ASR? There are pages of measurements. IMD, SINAD, THD. Many different test levels and frequencies.

 

9) Listening at ridiculously high volumes eg on the Focal Clear headphones at 115 db. Are you serious??

 

Another flat out misrepresentation. Did you even read the review?

 

10) The farcical review of HiFiMan Ananda headphones where he was simply way off beam.

 

Farcical how? Do you own it and he disagrees?

 

 

@laoman I will give you the benefit of the doubt  that most of this list is not your own.  It was not hard, even at my knowledge level to tear apart your list.

 

1) Failure to understand Klippel measurements

Example would be nice.

2) Poor testing methodology - eg the tests conducted on the Chord M Scaler

How so? I’ve read the test.

4) Testing cables for interference when they are not plugged in to anything

Not sure about this, if you're referring to power cable the cable was plugged into the wall receptacle.

7) Conducting speaker listening tests based on 1 speaker only ( I do not care what he says about the validity of this, as this is nonsense)

This is your opinion, which is fine but there is testing which supports using one speaker.

This whole thread makes me chuckle. Thinly veiled disciples of a cult “subjectively” preaching to a crowd of those who know better…then when the preaching doesn’t work they continue to sermonize with neither an invitation nor a rational purpose for continuing.

 

Amir seems like a sincere guy and his niche is his to do with as he pleases. Good for him and for those who hang on his every word. Why isn’t it a good strategy for those still hinged to just grab a cup of coffee and ignore the unhinged disciples until they hop back into their ‘88 Civics with the grapefruit shooter mufflers and return to Toppingville?

I see you have nothing to add but cheap insults @ghasley?

 

The rejection of science here is akin to fanaticism.

 

 

 

@laoman You clearly have no idea who you are talking, what my qualifications are and for whom I have worked.

Because you introduce this aspect of yourself, it is now imperative that you elaborate for the avoidance of doubt.

 

I’m not rejecting science @crymeanaudioriver I’m just rejecting the audio equivalent of fanatical Scientologists. U B U, but this isn’t the ideal venue for your message, you’re just too arrogant to realize you are much more entertaining as an anomoly than you are appreciated.

I am a longtime member here, and a member of several other forums, including ASR.  ASR has its good points and its bad points, as does AudioGon and every other forum.  Just as I am confused about the hostility here by many towards A/B testing, which is one tool, I am confused by the hostility towards objective measurements.  It seems that neither pure “objectivists” nor pure “subjectivists” are correct.  Sound is a combination of system synergy, room acoustics, and even a person’s hearing. So it seems that while neither group is absolutely correct, ultimately the subjective sound counts more to me in my system that objective measurements.  That does not seem to be a controversial position.

That being said, I struggle with the concept that differences in sound cannot be objectively measured, perhaps by REW.  It seems logical that a difference in sound should measurable in some way.  That goes especially for the idea of “break-in,” which theoretically could be measurable in some way.  If a power cord or speaker cable needs 100 hours of “break-in,” which I really dont understand, shouldn’t that difference be measurable in some way?

Power cables are a very good example of the objectivist v. Subjectivist dilemma.  I recently put some pretty pricey Shunyata Research power cables in.  The first one that I used was clearly (to me) an audible improvement over stock.  Why?  Who knows. But why isn’t that difference measurable in some way?  Logic dictates that it should be.  Same when I changed speaker cables.  Many cable manufacturers make all sorts of jumbo-jumbo marketing claims.  But shouldn’t there be a way to test those differences objectively between one cable and another? Sure seems so. Even if there is no way to measure the difference, I hear a difference.  Doesn’t mean that measurements are meaningless . . . It just means that we don’t have the means to test that difference, I suppose.

On ASR, the consensus is the opposite.  If it can’t be measured, then any difference is in the imagination or bias of the listener, which I know at least in my case is not accurate. Nonetheless, I like to know that my $$$ Shunyata power cable measures the same as lamp cord, even if it sounds much different.  To me that shows the failure of pure objectivism, although I can’t explain why the difference cannot be measured.

For similar reasons, I don’t understand the hostility among many to A/B testing.  I know that it is sometimes difficult to set that sort of test up, but logically, a listener should be able to discern differences quickly.  I remember a friend and I wanted to determine whether there was any difference between a manufacturer’s digital cable and a toslink one.  Switching back and forth, we were both in agreement that the Toslink cable sounded better. So there is a value to A/B testing too.

Then there is the tweaking.  Surely, if a tweak improves the sound, there should be a measurable difference, right? What about one of my favorites, the Shun Mook $5,000 record clamp made from aged ebony from swamps in Africa.  The claims made for why that magic ebony makes any more difference than a regular record clamp has got to be measurable in some way, doesn’t it?  Or are we supposed to simply accept the jumbo-jumbo without looking for some scientific basis?

The bottom line to my rambling is that ASR has its place and its utility.  People do not need to accept those findings as gospel, but they are a factoid to be weighed and balanced with other things.  Ultimately, the test is a subjective one:  regardless of measurements, how does it sound to YOU.  And that means that someone might hear an astounding difference and another person might not.  Doesn’t mean that there is no difference.  It just means that when you add a person’s hearing into the mix, it sounds better or worse for that person.

@moto_man  you started fine then rejected science. You can pick and choose what you believe but that is the point where you transition from science to belief.  ASR people don't reject listening as a method they reject personal accounts listening accounts.  The science side has done many many blind listening tests, documented so they can be repeated, that have explored the limits of hearing. ASR does nothing but accept that science absent any well controlled studies that prove otherwise.  They inherently are not the people to prove otherwise in a controlled listening test as they are biased. The people here are. Ideally the best situation is the people from ASR running the test and the people from Audiogon being participants. One group will come away right. I have little doubt the ASR crowd would participate. Would the people from here participate?

@ghasley 

Thinly veiled disciples of a cult “subjectively” preaching to a crowd of those who know better…then when the preaching doesn’t work they continue to sermonize with neither an invitation nor a rational purpose for continuing.

Please clarify, which side is the “cult”?   
With both sides playing a zero-sum game, there is no room for compromise or understanding.  

@axo1989 

I can see your point of view regarding ASR. 

I don't know if you have been a member long enough to have seen some of my skirmishes with Amir and crew.   One got a bit crazy.  But for me it's always water-under-the-bridge.

@moto_man I suggest a good start would be to compare like with like, and at the most basic this would mean the same AWG. Same length, same connectors.

Anything else is meaningless because you may be comparing things that are not alike in their physical characteristics. 

If stock is 20 AWG, and the $$$ ones are say 12 or 14 AWG and are a few metres shorter, yes, you will hear a difference.  They will measure differently.

@crymeanaudioriver 

 

You do know that these measurements came about from observation first, the measurements didn't come before observation. The science will never further if the measurements stay in stagnation, the ear/brain is more complex than the standard measurements we use for audio.

@tantejuut

 

The problem I have is people telling me what I can not hear.

 

Again: do you have a problem with scientists who study human biology telling you what is or isn’t possible? The reason, for instance, scientists have sent up the Web telescope is to see things that they KNOW can not be seen from earth with the naked eye. Wouldn’t it be strange for someone to say "they don’t have to do that! They can’t tell ME what I can see or not!"

???

Therefore: Why are you not open to a suitable expert on a subject (in which you are not expert) explaining what you may, or may not, be able to hear? This stuff really has been studied! Just as the limits of human hearing in regards to frequency response has been studied, so have thresholds for distortion levels, dynamic range etc.

 

And that really does have consequences when we are talking about what type of distortions are likely in cables and how audible they are likely to be or not.

 

If I hear differences in cables, I want to learn what is happening. If other people tell me that it is impossible and I am delusional, I find that not the right attitude for investigating the parameters for what is causing that effect. (geometry, dielectrics, purity, etc...).

 

But then you really DON’T want to learn what is happening. That is:you are blocking off any answer you don’t like, especially one that would conclude you are wrong in what you thought you heard.

There are people who have good knowledge of electronics - what type of distortions are plausible or not, how to measure it, and also have good knowledge of the thresholds of audible distortion. Amir is one of them, but there are numerous others.

If you REALLY care about "learning what is going on" it may indeed entail that real audible differences are occurring in your cables. But it also MAY be the case no audible differences are occurring, for very well known technical reasons, and you REALLY MIGHT be mistaken in your perception. If you don’t allow for the latter possibility - one VERY well documented in science - then you really aren’t approaching this with an open mind keen to learn the truth.

@moto_man

 

As cryneanaudioriver pointed out: you really left science and engineering behind in your post because you have simply assumed (e.g. in the case of your Shunyata cable) that your perception is SO reliable that you just CAN’T be wrong, and that therefore if no technical theory or measurement can validate "What You Hear" then it MUST be tests that are wrong, not...ever....you!

THAT is the fundamental problem underlying most of the subjectivist/objectivist debate. The Utter Certainty many have in their own perception...which flies in the face of all we know and has been studied about the fallibility and liabilities of human bias and perception.

It seems either a case of flat out refusal to learn this due to maybe some ego-protection mechanism, because people wrongly feel they are being personally insulted if it’s dare suggested they are "hearing things." Or it’s a case of some people just not-knowing-what-they-don’t-know and so they just won’t accept any informed testimony that contradicts their self belief.

Which is too bad.

My son was involved in a large study for a peanut allergy treatment. It was double-blinded - neither we nor the researchers knew who was on the actual treatment or the placebo. This is STANDARD in such trials because of the well known influence of bias - people who know they are getting the treatment will often report it made them better (even if it didn’t) and visa versa. Wouldn’t it be strange for my son to have objected "How dare you insult me by suggesting I may be prone to imagining anything! I demand that you unblind this study. I can trust myself, why can’t you?"

That would just be a flat out misunderstanding of the nature of human bias, right?

And yet this is pretty much what one sees among many here: a flat rejection of the proposition they may actually be imagining differences, and a rejection of any way of coming to that conclusion. It’s a one way street: I KNOW I hear the difference, so the only answer I’m looking for is one that affirms that belief!

As I mentioned earlier:  I also felt very strongly I heard an "obvious" difference with a Shunyata cable in my system.  But I was open to the possibility of listener bias as well.  So I did a blind shoot out and when I didn't know which cable was which, there was NO detectable difference - my guesses were completely random.

Saved me a lot of money :-)

It's too bad more audiophiles haven't had such experiences.  It's an eye-opener.

@axo1989 No you are so wrong. ASR nope never, Darko never even frequent his site or YouTube as he reviews the cheap crap Amir does. 

Swing and a miss. 

Try again this is the only place I post at. WBF I just read as they have people who are real experts there. Not posers like ASR. 

BTW Juan Manuel Fangio II was an Icon in F1. My Grandfather was an engineer on the Alfa Romeo team in 1950 and 1951 working with Mr. Fangio. Juan one 5 F1 Championships. 

His Nephew Juan Manuel Fangio II (my moniker) was a very accomplished IMSA and AMLS driver. 

Keep fishing. 

You do know that these measurements came about from observation first, the measurements didn’t come before observation. The science will never further if the measurements stay in stagnation, the ear/brain is more complex than the standard measurements we use for audio.

 

Did you read what I wrote? Scientists continue to do testing on human hearing to explore limits but those limits change at most now by very small amounts. Scientists are doing that. Audio companies make claims with no basis. It is quite a different process.

 

You have a belief that our ear and brain have a complexity that cannot be tested by current measurements. That is your belief. I do not see Amir disputing that for speakers. Do you? He does and it appears almost all on the scientific side dispute that for many products such as the oft hated cables (accurately most cables). No one has proven them wrong that I can tell. Lots of beliefs but no proof.

 

If you REALLY care about "learning what is going on" it may indeed entail that real audible differences are occurring in your cables.

 

I absolutely am open to the possibility. However, without any valid proof, not belief, but proof, I will err on the side of what has been proven. I used to be convinced of the same thing people hear believe till I was "forced" to accept otherwise. I don’t think any of the detractors here have ever truly tested their beliefs. How can you claim to have strong convictions if you are unwilling to test them?

 

There does seem to be consensus on the engineering side that some cables can have audible effects. I don’t see black and white, but nuanced reasoned positions. I am not seeing that from competing beliefs.

@prof 

it is not about expertise nor a defensive reaction to scientific explanations. If I hear more detail, I hear more detail. Simple as that.  Calling that delusional is wrong. The assumption that I really don't want to learn is incorrect. I learn everyday. From diyaudio, Agon and ASR. I am an open minded engineer. Maybe iIt is difficult to accept that some people have better hearing skills. Other people have beter measuring skills. 

 

 

 

Post removed 

@prof, I think you misunderstood some of my points. Starting with the basic assumption that, for example, power cables can sound better, that should be something that is objectively measurable. If it cannot be, why not? I personally have heard differences between cables - not all, mind you, but some. Logically that should be measurable.  I heard a sonic improvement when I added an ARC REF6 instead of going DAC direct to amp, although that was counterintuitive to me.  That difference should be measurable too.  But ultimately, assuming that measurements do not show any difference, does that mean that I am imagining a difference or we have not developed a methodology to test differences in soundstage,for example.  I am pretty sure that I am not imagining things, but always open to confirmation bias.  That is why I ask the ultimate question: If it doesn’t measure differently, does that mean ipso facto that there are no sonic differences?

@prof I admit that my friends and I are either lazy in your opinion or don't care to measure/take scientific accounting of why our equipment is sonically different from other equipment (cables, tweaks included).  We don't care when we feel it is better/more enjoyable.  If the change is worse, we unplug and disown it.  

I read measurements when available.  One of ASR's long time members writes how he loves Von Schweikert speakers and now owns the VR5.  I don't recall many published measurements of his past or current speaker (or any of the VR5).  There are several published reviews sans measurements.  That didn't stop him from purchasing it and loving it.  

@mitch2 

Please clarify, which side is the “cult”?   

Whichever side is the one that believes they are right and the other is wrong. It varies by the individual regardless of ideology.

 

A new Camry is a better car in every measurable way than an old bathtub Porsche. I know which one I’d rather own. A new iWatch keeps better time in every measurable way than an old Zenith chronograph. I know which one I’d rather own. A new cello or guitar is likely more “accurate” than one from 250 years ago (cello) or 50 years ago (guitar). I know which one I’d rather listen to. 

 

I don’t need or desire to convert anyone to anything. Those that do are attempting to do so for another purpose.

@jerryg123 

I learned long ago not to engage ASR minions. You’re basically conversing with pre-programmed robots 😂 

it is not about expertise nor a defensive reaction to scientific explanations. If I hear more detail, I hear more detail. Simple as that.

 

^^^^

You literally contradicted yourself within your first sentence.  Your posts really do exemplify precisely the problem here.

So tantejuut, is it your contention that, unlike the rest of the human species, you are totally immune from perceptual bias effects?  That you just couldn't be wrong in what you perceive when you "hear" something?

 

 

If anyone is getting tired of beating this horse to death please try some other threads. I just started one on Atmos music, if you are interested in immersive audio please drop by. If you want to "measure" in immersive audio it is very easy and you can just use your fingers. (with 5 channels, or 7 channels you can use your fingers, when you go above 10 channels it gets a little tricky).

Post removed 

@moto_man 

 

The thing was, your post started off fine with the idea that IF X is audible, it makes sense it should be measurable.

Except throughout the post you kept implying that you ARE hearing differences and from that conviction...therefore it should be measurable.

There wasn't really an acknowledgement of the obvious variable that you could be misconceiving differences that aren't there.  It was more about "I hear it...so why can't we measure it?"

"That is why I ask the ultimate question: If it doesn’t measure differently, does that mean ipso facto that there are no sonic differences?"

Remember that measurements, and measurement devices, didn't just arise out of some abstract vacuum.

The main reason measuring devices arose is to extend the known limits of our senses!  That's why we need devices to detect X-rays that we can't see, telescopes to see distant objects we can't see, devices to detect radiation, ultrasonic noises we can't hear, and on and on.  The measuring equipment used for audio gear can reliably detect and quantify both things we can hear, and cannot hear.

And the the use of measurements in audio only arose by correlating those measurements to what we hear.  That's the whole point.  It seems lots of audiophiles start with this strange assumption that measurements in regards to audio equipment are just some laboratory abstraction, whereas they arose by careful correlation to what we hear (and can't hear).

So, as to your question: It will depend on the particular claim.  We don't have Absolute Certainty about anything of course, so it's a matter of adjudicating the likelihood based on what seems to be known.  So if you take an AC cable, measure the signal with an expensive cable vs cheap cable and there is no detectable difference, that strongly implies it's not changing the signal.  And therefore it's more probable a bias effect is responsible for the listener thinking he hears a difference.  It's not Absolute.  Just the more probable explanation.

Someone may object and say "Ok, but what If I AM hearing a real sonic difference that you can't detect by those instruments?"

Ok...how could that be tested?  You CAN also test that claim: do a blind test to remove the possibility of listener bias.  If you can detect the difference reliably, then even if the measurements are the same, this DOES suggest there is something audibly detectable happening.  You are vindicated!

But if you are going to reject BOTH any attempts at objective verification (measurements) and subjective verification-with-controls (blind tests)...then what is left?   What way forward to you have to figuring out what is actually the case?

If the way forward is "always trust our perception" then that flies in the face of all we know about the fallibility of our perception.  And it also leads to countless contradictions where one person perceives "no difference" and someone else "obvious difference," which tells you NOTHING therefore about what is actually happening, and it would validate literally every crazy claim anyone has ever conceived (because no matter how crazy the idea, there are people who believe they are experiencing it).

 

 

 

 

 

 

 

I learned long ago not to engage ASR minions. You’re basically conversing with pre-programmed robots

 

This is the deep irony/hypocrisy that almost always arises in these threads.

For the most part people making the "ASR-type case" are trying to offer a reasoned case with civility.  The ad hominem and insults, like above, tends to come from the "anti-objective" side...who then go on to blame the "objectivists" for being the dogmatic thread-crappers.

And then also claim it's the objectivists who are close minded hive-thinkers.

This is why I mentioned earlier, the level of "projection" one sees in these threads is often quite amazing.

 

@prof  , people here have shown their underlying nature. I am sure others reading this will understand and accept your well thought out posts even if those you target do not. Most will see that your basic logic is sound and what you are being met with is emotion not logic or clear thinking. 

 

If people are not willing to accept the most basic, irrefutably obvious premise that their senses are inherently fallible, then there is no hope for an intelligent conversation. It is impossible no matter how hard we try.

So tantejuut, is it your contention that, unlike the rest of the human species, you are totally immune from perceptual bias effects?  That you just couldn't be wrong in what you perceive when you "hear" something?

No. The assumptions about my hearing capabilities and my openness to learning sound a bit dogmatic. I think being right is more important then enjoying audio for some people. Have fun measuring while I hallucinate and trip on my silver wires ;)

I have seen this stated more than once "Science is observation then measurement". It's not really how it works,  it would be "verifiable observation". Science has no interest in measuring every non verified observation. "I saw a leprechaun hiding gold under a rainbow" isn't a verified observation neither is" I heard differences swapping power cords".  If you heard differences between power cords during a controlled blind test then that's worth investigating. That's a verified observation. 

 

@prof, excellent and very thoughtful answer to my post.  I agree wholeheartedly that if something measures differently (and I referred to REW, and not just S/N, distortion figures, etc., because that theoretically should give you lots of data points that show a difference when something is changed in your system, since something should change in some of that data if it sounds different). If you think that there is a difference, despite no objective support for it, A/B testing is the perfect way to eliminate confirmation bias.  Can a difference in depth of soundstage, or positioning of instruments within a soundstage be objectively measured?  I don't know the answer to that. What role does confirmation bias play in me believing that I hear a difference?  I don't know the answer to that either, although I like to think that I am being objective. I replaced an Audience Power Chord that I had used for a long time on my DAC with a $$$ Shunyata one (same length, but slightly lower AWG after liking what they did for my Preamp (over stock) and speakers.  I can honestly say that I hear no real difference . . . maybe an ever so slight improvement, but that could definitely be representative of a struggle to hear a difference because I expect/want a difference -- the paradigm of confirmation bias.

 But as you accurately point out, whatever the answers are, A/B testing should yield a consistent result that eliminates confirmation bias. That is why I am surprised that A/B testing is not more widely accepted here on AudioGon.  A very interesting thread as putting many manufacturers' claims to objective tests has always been an interest of mine.  Thanks for the thoughtful response.

@crymeanaudioriver I personally would love to participate in A/B testing for anything, but especially the seemingly wild claims of things like the Shun Mook, Stillpoints that you scatter around, risers that elevate cables off the floor, that weird brass salad bowl that "snaps the soundstage into focus," etc.. . every manufacturer has some sales patter regarding how their tweak real works, but no one really cites either objective measurements or the results of A/B testing. That would be a lot of fun! Maybe some tweaks manufacturers would be willing to do some A/B testing at Axpona?

Have fun measuring while I hallucinate and trip on my silver wires ;)

Since when does saying ALL humans have perceptual biases the same as saying someone is hallucinating? The rejection of basic science here is mindboggling.

@crymeanaudioriver 

 

Indeed.  I'm always conscious that there are other people reading who are more open-minded.

A lot of the rancor comes, as I mentioned, from the problem that some of us "don't know what we don't know."   And then that ignorance is projected.

So often one sees an appeal to "But this is mysterious, WE don't know the answers to this" or "Science doesn't know everything, and Science doesn't have the answer for the phenomenon I'm describing!"    Which is often just another way of saying "I'm ignorant of the science on this subject" and then projecting that ignorance on to science or anyone else who is aware of the science.

There certainly are jerks on all sides of an issue.  But in terms of the basic approach, the "objectivist/ASR-type member" is starting with acknowledging the inherent limitations and fallibility of our human condition.  And then going on to ask "ok, how can we account for fallibility in our method of inquiry?"  It's a personal acknowledgement of fallibility as it is a general acknowledgement about our species. "I Could Be Wrong" is the fundamental starting point of the inquiry.

On the other hand, we have folks who are Absolutely Certain of the reliability of their perception.  It's unshakable - and if you try to bring any objective or control methods to the claim, those methods will be faulted, never that individual's belief.

And since this is essentially a religious-faith-like stance of personal dogmatism, it tends to lead to rancor.  The "belief and confidence in what I hear" is wrapped up in someone's view of themselves, and they think it can't be challenged lest the whole thing fall like a house of cards (since they won't accept the "way out" offered by more objective inquiry).  Therefore there isn't much else left to say "I heard it, that's that" and the only recourse is ultimately feelings of insult "how dare you try to tell me I didn't hear what I KNOW I heard!" and so we get lots of ad hominem.

As I've said, this Purely Subjective approach leaves no way to ever adjudicate truth claims about audio gear.  If the idea is that our perception is the Ultimate Arbitor, then in the very same setting evaluating equipment, audiophile A can say "I heard a difference between these cables" which is supposed to mean 'therefore there is a change in the signal.'  But if audiophile B is there using precisely the same method and reports "I don't hear any difference" then that should stand as a refutation of the first audiophile's claim.  But it never is, because audiophile A will always say "Sorry, I'm not wrong, it looks like your hearing just isn't as acute as mine because I know I hear the difference!"    It's a completely unfalsifiable method in this sense.

And the problem with unfalsifiable claims which resort to ad hoc reasoning like this is that they are consistent with any observation (I hear a difference, if someone else does it confirms my claim, if they don't, they simply can't hear the difference), and hence do not predict any observation.

Now, nobody HAS to give a damn about any of this.  No audiophile has to be a consistent thinker, or aware of all the science, or do any scientific or rigorous inquiry AT ALL when choosing gear.  But the issue is that people will inevitably make claims of truth from their experience, with unshakable conviction, and that's where we end up in this mess.

@prof

I can see your point of view regarding ASR.

I don’t know if you have been a member long enough to have seen some of my skirmishes with Amir and crew. One got a bit crazy. But for me it’s always water-under-the-bridge.

Nice post of yours directly above this one.

Re the quoted one, thanks. I think I first posted there around Christmas time. I read reviews a few years prior. Didn’t find your user name but give me a clue and I’ll follow up :-) Best to avoid heavy baggage I agree.

Scientific measuring for the sake of ascertaining something is useful and needed but not for every damn claim made by someone who hears a difference. The fanaticism exhibited here by some in the objectivist camp are akin to religious extremism.

Every conceivable excuse as to why you can't hear what you're hearing is right up there with being born with original sin. That you can't hear correctly and are a fool to trust your senses, is quite an asinine position to take for a harmless and simple hobby.

Saving you from yourself (emotionally and economically) is yet another parallel aspect of this religious like zealotry. So is having a flock of sheep followers and acolytes sent out to other lands (websites) to combat (think Crusades), proselytize and convert.

If god were never invented or ASR never existed, we'd all be right where we're at, enjoying our hobby and sharing our experiences, as if none of this ever arrived on our doorstep in a flaming paper bag.

All the best,
Nonoise

ASR uses science in the title but really reflects an engineering culture. Amir himself says they (generally) don’t do science, but measurements, which is correct.

My day job is in ecology, so I work with scientists, engineers, comms people, policy and legal and so on. In my experience science and engineering cultures differ: scientists observe reality, form hypotheses and test them via experimentation; engineers learn complex rule systems and solve problems by applying those rules. I think that’s why the core ASR dialectic is so linear-mechanistic. It’s all about the rules. Curiosity, less so.

I also like the old saying "in theory, theory and practice are the same, in practice, they aren't". The interesting people at ASR are these with enough experience and intelligence to see (and see the humour in) this.

Wow, I haven’t dropped by in a couple of days.  Still going, I see.

 

”The beatings will continue until morale improves.”

As I cannot claim to have absolute hearing, another one cannot not claim that my observations are 'wrong' from the start because my observations are not significant enough  (just anecdotal 'evidence'). I A/B a lot, but don't tell me from the start that my observations are delusional. It always comes down to cables because of the tiny advantages there are to gain in contrast with components. Let's asume that I might be right (huh no, the horror), are you willing to learn from my experiences and try to examine and study the differences. Or better, to learn from people like Galen Gareis, Garth Powell or Max Townshend. People that say I am rejecting science are incorrect. I combine technical information and measurement reports with common sense and good hearing/golden ears :)

@tonywinga

The beatings will continue until morale improves.

The best humour, so many layers!