Why HiFi Gear Measurements Are Misleading (yes ASR talking to you…)


About 25 years ago I was inside a large room with an A-frame ceiling and large skylights, during the Perseid Meteor Shower that happens every August. This one time was like no other, for two reasons: 1) There were large, red, fragmenting streaks multiple times a minute with illuminated smoke trails, and 2) I could hear them.

Yes, each meteor produced a sizzling sound, like the sound of a frying pan.

Amazed, I Googled this phenomena and found that many people reported hearing this same sizzling sound associated with meteors streaking across the sky. In response, scientists and astrophysicists said it was all in our heads. That, it was totally impossible. Why? Because of the distance between the meteor and the observer. Physics does not allow sound to travel fast enough to hear the sound at the same time that the meteor streaks across the sky. Case closed.

ASR would have agreed with this sound reasoning based in elementary science.

Fast forward a few decades. The scientists were wrong. Turns out, the sound was caused by radiation emitted by the meteors, traveling at the speed of light, and interacting with metallic objects near the observer, even if the observer is indoors. Producing a sizzling sound. This was actually recorded audibly by researchers along with the recording of the radiation. You can look this up easily and listen to the recordings.

Takeaway - trust your senses! Science doesn’t always measure the right things, in the right ways, to fully explain what we are sensing. Therefore your sensory input comes first. You can try to figure out the science later.

I’m not trying to start an argument or make people upset. Just sharing an experience that reinforces my personal way of thinking. Others of course are free to trust the science over their senses. I know this bothers some but I really couldn’t be bothered by that. The folks at ASR are smart people too.

nyev

Showing 19 responses by andy2

An ignorant audiophile or ASR believer is guilty of the same thing.  They don't question.

To the ASR crowd:

Are you using a 1KHz tone?

Do you do some basic IMD3 test?

I mean music is infinitely more complicated than that.

 If frequency response is flat and independent of load, has distortion and noise below threshold of hearing, then you can very confidently declare is transparent.  This analysis assumes perfect speakers.  To the extent the speaker is not, then the job gets easier and hence the reason amps with noise and distortion above threshold of hearing are also declared as transparent.

Why then SS amp always has a haze where as tube amps always has a transparent sound but we all know tube always have inferior frequency response vs. ss.

In short you can't measure it.

 

See, all explainable.

I don't think you explained anything.  Tube always has inferior freq. response to SS amp and higher distortion but most people will favor tubes due to its more musical nature.  Of course if a bad tube amp very high distortion you can tell, but most tube amps nowaday are pretty good.

FET amp with its being a square I vs. V curve sounds more tube like but its weakness is that it is less transparent vs. Bipolar and not as dynamic.

Here is the thing.  The freq. response curve and distortion will only tell you so much.  How can measurement tell you if it is a FET amp or Bipolar amp?  But a quick listening will tell you the difference between a FET vs. Bipolar.  FET amp has gotten much better now, but in the old day it was very "hazy" vs. Bipolar.  A lot of amp now uses FET as an input stage and Bipolar at the output stage.  Just like using tube as input stage then SS as the output.

 

Also if you look at a speaker freq. response and distortion, it is an order of magnitude (or even higher)  higher than anything audio chain (amp, preamp), so  measurement would tell you that it will dominate anything in the upstream components, it is not.  You can hear the difference with different amp or preamp.

On what do you base this claim?

I myself like my tube amps, but so what?  The vast majority of audiophiles use solid state amplification and are very happy with it.  (And that includes many who have compared with tube amps, or who had previously owned tube amps).

That is because a good tube amp will cost a lot more money compared to a SS amp.  To get the same performance you need to spend quite a bit more.  If money is not an issue, most people would go with tube.

The "haze" that you keep speaking of remains completely anecdotal so it doesn't really address Amir's points about how to reliably make such determinations.

The "haze" is there.  In the old day it is very apparent in SS amp, but now SS has gotten a lot better so you don't notice it as much but a listen vs. a good tube amp will reveal it.  FET amp tends to be guilty of this more so than Bipolar.

Look if SS is so perfect than nobody would use tubes.  But SS has its flaws but people will ignore it since it can output a lot more wattage vs. tubes.

 

prof,

If I remember correctly, you had stated you could not hear any difference in cables.  If that is the case, I am not sure I can take your words seriously.

 

 

Good luck with that!. ASR often doesn't bother listening at all to some of the components it tests. It just isn't important to them if they have their measurements to review. I think looking at numbers is more fun to them.

Amir has claimed that he personally listened to "200" pieces of equipment per years.  That is around 366/200 or 1.5 days per equipment.  I mean come on who in the world can take you seriously if you only spend such a short time evaluating an equipment.

In comparison, people at Stereophile spend weeks on an particular equipment before they publish the review.

 

https://www.theaudiobeat.com/visits/shunyata_visit_interview.htm

(This link comes from a discussion here at Audiogon).

I think Amir can learn a thing or two from the link above. It actually measures transient affect of power cable. I think Amir mostly measure frequency response which is steady state. A lot of thing happens in transient.

Amir is like a superman in term of listening.  It only takes him 1.5days whereas it takes people at Stereophile weeks. :-)

If you want to point to specific examples to make your case

I think Amir needs to test equipment using transient methods.  I think his tests mostly are done using frequency domain which is steady state.  Most of stuffs in music happens in transient.

 

Phase and Magnitude in the frequency domain transforms into the time domain.

That is true in theory but I don’t think Amir even doing that. But jitter is difficult to test in frequency domain, just to name a few.  There are more.

No it is not.

You could convert the phase noise from say a 1kHz tone to jitter in time domain, but jitter measurement is easier to measure in time domain.

Measuring phase noise will need a fairly expensive piece of equipment to do it right, but a more affordable real time scope can do the job better.

Also to measure phase noise you need a pure sine wave.  But in time domain, you 

could do it using a square wave or some transient waveform, which is more akin to real music.

The other thing is that jitter is not one number as is often talked about. Above you see multiple jitter sources at different frequencies and levels. This makes FFT analysis far superior to any time domain jitter measurement that spites out either a number or even a distribution.

That is true. Jitter could be random, periodic, ISI, DCD and I am sure there are more. The tone in your example measure periodic jitter which can be done in time domain as well. For a pure sinewave, you could use frequency domain, but with non-sinusoidal waveform (which is more akin to music), it’s better to use time domain.

There are transient events that can only be capture in time domain such as overshoot or undershoot or ringing or more .,.. It is fine if you only use frequency domain but it won’t be a complete test.

 

certainly not in any audible way

That statement in itself is subjective.  I don't think ASR has any data on whether something is within or beyond our hearing threshold.  The tests they produce cannot be used to say whether something sounds warm, bright, musical, thin, analytical, has a wide/narrow soundstage ... and so much more.  At the end of the day, you just have to listen.

Measurements can only tell so much about the piece of equipment. At the end of the day you have to listen.

Measurements cannot tell if something sounds warm, bright, musical, organic, analytical, transparent, soundstage width/height/depth ... just to name a few.