What if a high end speaker measures really badly?


You know, it's true that I feel listening is more important than measurements and that it's generally difficult to really tie together measurements with pleasure.  Below 0.05% THD do I care?  No I do not.  I really don't care. The number tells me nothing about whether I'd like the amp more or not anymore.

In this one memorable review for the Alta Audio Adam speaker, I really felt shivers go up my spine when I looked at the measurements, especially at ~$20kUSD.   This looks like an absolute hot mess.  Does it sound this bad though?  I certainly don't have the $20K to test that out myself. What do you all think? 

erik_squires

Speaking of measurements. I think one of the most pertinent yet often absent metrics is distortion. And not just THD, but also the profile of the individual harmonics. Other than those who use the Klippel (Erin’s Audio Corner for example), I don’t see such measurements.

I think B&W 800 series might make for a good case study. Despite their non-textbook frequency response, I don’t find them nearly as fatiguing as other brands with similar responses. I suspect that’s because their drivers are low in distortion, especially offensive higher order harmonics.

@helomech For sure…. i don’t even see much evidence of level matching…. or a basic understanding of the noise floor of the listening room. But we can certainly model some good behaviors and practices…best to you in music

The audiophiles who denounce the merit of measurements tend to be those who cannot or do not understand them. Coincidence? 

I don't have robots and machines in my place listening to music so I don't care what they have to say, so I use my ears and brain for measurements. If I like how it sounds, it measures great for me... 

This is very simple , The High -End speakers must to be got good sound (using you hearing ability and must got good measurements ( No big wide dips ets) . If The measurement is bad and you like the sound . Something wrong with you, but if   measurements is good  sound some time lifeless , becouse  Speakers company try to flattering responce using very complicate crossovers with a lot capacitors , unductors  , killing the sound, One time i check Canton High End , nice looking and big Ls, Responce was very flat , but sound was bad

Zu is a popular speaker that doesn’t measure that great. And they do not threaten to sue people about it either.

It’s curious that expectation bias from speaker measurements is just as likely to develop as from a speaker’s: appearance, price, name brand etc. (i.e. “conventional” sources of such bias).

Where measurements get interesting is how folks can have more-or-less informed background knowledge / experience with which to interpret them and develop extrapolations.

An important consideration is how “good” measurements could be used to fillip experimenter bias much the way some “conventional” speaker preference-driving traits have been used. In the case of measurements, I wonder if the effect will be more pronounced. That seems a possibility given (1) the average consumer’s probable lower level of consistency in understanding a suite of data, a spin graph / score, etc. (vs. a characteristic that doesn’t require as much understanding of analytics), and (2) the obvious fact that while good measurements don’t insure a speaker will sound good to a given listener, there is good reason to predict / assume this.

For average consumers, I think measurements = just another category with which folks will have to pick their individual points of “honesty-with-oneself” in order to use them efficiently (or avoid them) … (again, as consumers). Obviously, it’s different for designers, who by virtue of their trade should be increasingly considerate of measurements since they’ll potentially face an increasing trend of such data for their products. The recent thing between one designer and a couple of data gurus online is an extraordinary free lesson towards this angle, for anyone else in, and everyone entering, the trade (IMO).


As some of the knowledgeable designers have pointed out, relevance of measurements really depends on certain things more-or-less important to the given listener, and how the listener will have the speakers set up. But predictions / assumptions developed without a sufficient first-hand frame of reference (comparing multiple measurements x multiple speakers) could be spurious.

And even with much experience (in measurements x speakers consumerism), starting a speaker hunt with measurements in mind is starting a speaker hunt with bias. Perhaps not all bias produces poor real-world results. 😉 It’s an intriguing conundrum.

Asked another way, if this is a high-end speaker, then is there anything we can objectively point to besides the price tag as "high-end?"

I'm of two minds about this question.

On one hand, I do want my speakers to measure well.  It suggests good engineering for one thing.  Also, if something is too colored I think it will bother me either immediately or over time.  So I always look at measurements.

On the other hand:  I have really liked some speakers that have been torn to shreds on ASR, e.g. the Devore O series speakers.  Devore managed a canny combination of generally neutral on axis sound (O/96) but with some zigs and zaga and I think some resonance.  The end result is a speaker with a character that I found utterly engaging, on all types of music.  Since I've never owned them I'll never know if my initial audition impressions would hold up, or improve, or if I'd get tired of them over time.

I like that my Joseph Audio speakers generally measure well, and are generally well regarded even among the "measurements" crowd.   They have a mild "smile" eq, but it is so cannily done it I find it extremely pleasing and seems to give a bit more tonal "life" to the sound.

I'm thinkin' someone switched out the real speaker graph for a recent DOW stock market graph!

Regards,

barts

Some bumps are good and others not so much.

With DSP, you get to add bumps where needed and where you want them to be, not where they just happened to be when the product shipped.

I find with most speakers I tend to like a bump from ~4-6khz. That adds a bit of edge and definition, much like one might expect with a very good pair of high efficiency horns. In particular it helps to keep your attention at lower volumes. The other tweaks I might apply often tend to be more room and listening position dependent.

 

In the chart in the original post, that relative peak at ~10k in conjunction with the dip just below will likely result in a piercing sound (more fatigue) that might only benefit in certain more extreme cases of hearing loss. Would not be for me most likely. though again it may be nothing that some smartly applied DSP couldn’t resolve. But even if so, better to not have to apply DSP to fix what appears to be a significant design flaw. Better to go with a more suitable design right out of the gate where any bumps perhaps might be better located and maybe even work in your favor in some cases. You decide! To me a good design is always preferrable.

I find people that don’t think measurements matter just lack experience. Use REW (it is free!) and start making your own correlations. 
 

I have had/have 4 speakers that have full kipple measurements posted publicly. I find frequency response and dispersion to transfer very well from measurements to my room.  
 

what I think is still missing in measurements is detail and transient response. The ability of the driver to start and stop with no over hang or over shoot. 

Actually, the studio version of the L100 was made to try to replicate the sound of the Altec 604 of the day.

Everyone should own a pair of L-100 at some point in life…. and of course the much better L-110

My take:

Without prejudice to the fact that I am currently a card-carrying HARBETH disciple with their famous class-leading flat frequency response curve that measures in the top tier ….. and their best of breed midrange …… Just Fuhgeddaboud about all the textbook graphs and like shite, and just refer to your ears and senses in real life experiences.

For example:

In 1970, JBL released the iconic L100 Loudspeaker. Over the years, the L100 became the bestselling loudspeaker in JBL’s history. These were rock recording studio monitors with a roller-coaster and sine wave frequency response graph …..and everybody loved them.

These were everywhere in the early 1970s and onward, because they sounded great, thet were small compared to other speakers that sounded this good, and they played very loud without needing much power. (a perfect recipe for the college cohort budgets now buying the new gear)

The L100 was designed for rock & roll, efficiency, power handling, sine waves frequency responses (…heavy boosted treble, another peak in mids, AND a big boost in bass ) and sharp musical transients.

KEY POINT.
They were renowned as THE studio monitors in that era springing up in the west USA studios BECAUSE they dramatized / emphasized the recording industry engineers approach back then capitalizing on the prevailing music genre and purposely punching up the top, middle and bottom with peaks and valleys. Your favorite classic rock acts were probably recorded with JBL monitors, when L100s ruled the world.

Their easily identified sound, the so-called West Coast sound, was once a highly touted marketing feature.
- JBL speakers identified immediately as having a very pronounced treble peak
- JBL speakers as having a somewhat ragged and peaky midrange that could put the vocalist in your lap,
- booming bold bass
- Ad copy claimed that musicians and recording engineers were buying or stealing the original model 4310 (a professional studio monitor that preceded the L-100s) for home use.
- JBL did succeed in installing these monitors in most large recording studios in the 1970s, including Angel, Capitol, Deutsche Grammophon, Elektra, EMI, London/Decca, MGM, RCA, Reprise, Vanguard, and Warner Bros.
- Although they may have been responsible for some bad studio mixes from the ’70s and ’80s, even by today’s standards, they do amazingly well for a 3-way speaker with only 2 crossover components. Their relatively high sensitivity generates an incredible attack giving music an energy and presence that few other speakers could reproduce back then …

@erik_squires oh you're right, DSP doesn't/can't really fix "nulls" (I guess actual EQ in general isn't great at this to a degree). 
Good points on auditioning aspects especially  in a showroom/other space....which leads me to my ultimate dream business....

RENT YOUR FAVORITE SPEAKERS FOR A WEEK" © ,TM, ®.
Take over some closed up Rent-A-Center, dump a ton of capitol in a slew of speakers, and offer a deliver and rental program where you can audition speakers you are thinking of buying for one week.  Say, $300-$1200+, but if you buy the speakers you get the rental included in the cost.  Seems like a lot, but imagine you actually bought the $8000 speakers and ended up not liking them...you sell them on Audiogon for a solid $1000 discount to get rid of them!  This would solve SO many problems for everyone!!  🤣😎

And re the bass eq you speak of is available in the Sub 3 starting at $3k…. 

Disclaimer - i have Treo CT / sub 3 and 7 mk 2

@erik_squires AND you get time and phase correct, very flat to beyond 25 k and near perfect impulse and of course excellent waterfall ( unless you like cabinet colors…. )…. since 1977….

PS - I should point out here that I think we sometimes make the mistake  of auditioning speakers at different volumes than we actually listen to at home.  If you listen loud, audition loud.  Otherwise, spend most of your time listening at the volumes you normally would.

Kind of related to this is that a well treated room improves low-volume listening and decreases listening fatigue.

@amtprod The DSP fixed frequency response and killed the magic.  DSP isn't the answer.

@amtprod  I think @audiokinesis  was making some of those arguments, that some of these deep valleys may not actually be something most of us would become aware of.

No, if you like the sound of speaker Y vs. X buy Y, absolutely.  The one caveat is that long term and in room listening matter more than short term auditions. 

I don't think you can fix the nulls with DSP at all, but mid-treble I think could definitely be cleaned up at least a little. 

I also don't necessarily think perfectly flat is great, but allow for some discretion in bass bumps, and treble lifts.  So, if we squint and really apply major smoothing to the chart these speakers they do seem to be inspired by Fletcher-Munson curves and could be excellent mid-volume speakers.  Perhaps that will alleviate the otherwise poor (for a 3-way) sensitivity ratings?

@erik_squires is that speaker measurement (anechoic chamber) and it's imperfections become mute at nominal listening distances in an average set up room?  Therefore does the measurement really matter in choice of purchase, if you liked the sound more than X or Y speaker?

Granted, I think there were some solid points made for similar priced speakers that DO have damn near perfect frequency response graphs (assumed anechoic). 

I recently listened to a system that was fully active DSP processed: near perfect 'in room response' graph.  The bass was spectacular....but to my ears the whole really sounded 'meh'.  Without the DSP, I felt like that system had character, unique, some things I liked a whole lot more...some aspects suffered, like the bass control/detail.  I wonder if you 'DSP' those Alta speakers to be more even in response, would they sound "better"? 

@deep_333  illustrates the deep, deep chasm between DIY builders and kit makers, modders vs. the high end industry writ large. 

"How can a speaker maker offer such poor performance for so much money" they ask, and sometimes I have trouble defending some models.

@erik_squires 

As you may know, many guys on the diy forums (i have seen your name there as well) can do something better with the same parts than the guy asking 20k for this (facepalm)... This guy trying to make the easy cash did not deserve 20k in my books (no thanks).

Every speaker i own above a certain price point is something i can't cook up on my own. It immediately disqualifies manufacturers purchasing 3rd party drivers and throwing them in a box for me. I tend to pay for things i can't do on my own.. Unless if it becomes too much of a time investment/hassle/screwups/etc at a low enough price, it begins to reek "Just buy the damn thing and get it over with!".

 

Question: when FR graph such as those above show the db level at, say, 1khz, does the measured response include any other frequencies - such as resonances introduced by the speaker?

Also, I assume, the graphs alone do not reflect phase consistency between a fundamental and the harmonics typical in music, or differing decay rates for the fundamental vs harmonics. I believe these factors are critical for imaging and musical realism.

Be careful @erik_squires.  Another Eric may sue you for posting about measurements.   Oh, wait, wrong choice of words.  He may "litigate"...

@deep_333  illustrates the deep, deep chasm between DIY builders and kit makers, modders vs. the high end industry writ large. 

"How can a speaker maker offer such poor performance for so much money" they ask, and sometimes I have trouble defending some models.

Measuring per specific room is important. That gives a consumer an idea if these speakers will match his/her room.

This is an area where I think Vandersteen does it exactly right.  Uses an active woofer with built in EQ and a low pass filter for the amps.  In hotel rooms this delivered exceptional bass in a tiny room.

PS Everyone says "listen to these before you buy. My point is you may not catch these dips in a 15 minute audition.

@carlsbad2 

Yes, exactly. With a little experience, and a lot of misspent money/youth you’ll realize how extra-sexy speakers which reveal sounds you’ve never heard before, won’t actually last long in your listening room.

Oddly, where these speakers do measure well is in the horizontal dispersion. I’d expect they have an excellent and wide sweet spot, though not a very tall one.

In high-end industry crowded by unaware and uneducated rich kids of baby boomers you can take different approaches. 

1) Design Measure Build and Measure again then present and advertise

2) Build Present and Advertise -- provide unmeasured good looking parameters.

Measuring per specific room is important. That gives a consumer an idea if these speakers will match his/her room.

 

I don’t think we can say much of anything about that graph, and the others presented here without knowing the level of smoothing applied to the raw data.

 

@bruce19  True, but the problem here is that, if anything, the graph was not smoothed enough! 🤣 Are you suggesting maybe this speaker is far worse than it seems?

My point is, we know at least that those deep valleys are not due to over-smoothing.

A speaker can sound very good yet have a significant dip (or more than one). Generally that dip is at the bottom and most people check for that by playing songs heavy in bass. But a dip at a different frequency might not be caught until you play that one song that has an important note at that frequency and you say "what happened to that chord?"

Then you know something is missing and can’t enjoy the speakers any more. I do like to see a graph or a published number. Here are the numbers from my speakers: 20 – 20000 [Hz] ±3 [dB]

Looking at the graph for this speaker, it looks like the numbers would be 20-20,000 hz, +4/-8 dB. I think that would raise some eyebrows.

Jerry

PS Everyone says "listen to these before you buy. My point is you may not catch these dips in a 15 minute audition.

I think the up/down peak/dip jogs are artifacts of the enclosure design, which is apparently a transmission line/port hybrid. 

 

@audiokinesis Ahhh! Thank you, I missed that in the article.  That explains why they posted the inner design of the 2-way as well.

A lot of high end speakers measure like poopy and a lot more sound like worse than poopy!

don’t buy that one easy!

use your ears and get in your CAR AND DRIVE TO AN AUTHORIZED DEALER NOT JUST SOME STUPID HOTEL ROOM SHOW AND HEAR DIFFERENT ONES!

I don’t think the measurements should be ignored completely when buying speakers, even if they sound good to your ears. Over time, and outside the showroom, any serious flaws might start to become apparent. Reviewing the impedance graph can be even more important in terms of matching with your amplifier. Comparing sensitivity and nominal impedance only can result in a mismatch if there are some dips that your amplifier is not equipped to handle. 
 

@erik_squires I don’t think we can say much of anything about that graph, and the others presented here without knowing the level of smoothing applied to the raw data. As I am sure you know anyone who has played around with Room Equalization Wizard software knows that you can make a washboard look like a pancake with adequate smoothing applied to the chart. It’s frustrating because that critical piece of information is very seldom supplied with charts such as these when published.
this has been a nice thread so far, thanks to the OP and all the contributors. It has sparked some thoughts that perhaps I will share in another thread.

@erik_squires - that's a very ragged frequency response graph. I don't think speakers have to measure perfectly to sound good - Wilson Audio speakers are not textbook. But there's a difference between small deviations and big ones.

Efficiency is important to me as one of my amps (a class tube A SEP) has relatively low power...impedance is important, but the sound is really all that matters...and I'll never buy anything without auditioning unless it has a very fair return policy. 

I’ll go out on a limb and assert that in the end, proper application of measurements always helps to achieve one’s hifi sound goals faster, more effectively and for less.

The trick is to be able to understand and apply the numbers properly and I think that is not easy but a worthwhile goal for any audiophile.

More good and reliable data informs better decision making. But the devil is always in the details. Practically though, each will end up finding their own way as best they can. Sometimes it’s the journey that matters more than reaching the final destination.

 

It’s all good. Cheers!

Measurements are not important; it is how the equipment sounds to you that matters.

Sometimes, it's the charts/graphs/measured specs that catch the eye and make the ears desire a listen of....   But having to explore and posit what v. why to such a degree makes this mortal consider that make these 'A' series units seem to be 'space finicky'...

You wouldn't know if you Really Like them until in Your space with them.

At 20K$-ish, one might be tempted to look about at 'other items in place' and enter  into the old '...what if it's the....?' hunter/gatherer routine....

No dog in the hunt (and no $ to join in, either), I'd keep shopping.

Don't need more complications in a life with enough already....

A 195hz 'dip' due to the enclosures' back panel...Occam's Razor, anyone?

Fwiw I have kef ls50 meta ( + Klipsch sw308 powered sub), Ohm Walsh and Sonus Faber Concerto Domus each in different rooms. I use Roon DSP to tweak the sound of each in their corresponding rooms. The KEFs are known for their good technical measurements. The Sonus Faber also have measured well but not as well as the KEFs. I have seen measurements of earlier Ohm Walsh models from years ago and they tend to be good but are not as conclusive perhaps due to age.

Each room’s acoustics measure much differently and each has its rougher areas that I have tackled via room correction using Roon DSP.

These are all “good quality” speakers. Once room is corrected for they start to sound more similar than different in regards to tonality. Soundstage imaging and detail is very good in each case but each is somewhat unique in this regard.

So once room is corrected I then use Parametric EQ in Roon DSP to tailor to my taste. The good measuring kefs require the least, just a bit of a bump from 4-6khz to liven things up a tad. The other two may get a similar bump but there are also remaining high end and bass related tweaks I apply to get them sounding just right to me at my listening position.

So after all that in the end they each sound quite similar in regards to tone. The kefs are the ones that reveal the most detail in the recordings. The Sonus Faber provide a touch of added “musicality” that I would attribute to their cabinet designed to deliver sound more like an orchestral string instrument. The pseudo-Omnidirectional Ohms are somewhere in between and always excel at delivering a live like sound where the players are in your room as opposed to you being drawn into the recording.

So there you have it. Measures serve a purpose to help differentiate gear out of the box and also facilitate getting them tweaked effectively as needed but alone do not assure a clear winner. No surprise there eh?

Also I have learned that DSP is the great equalizer. No reason these days to be stuck with the sound you get out of the box. If the speakers are up to the task given the room at hand, almost anything is possible from there with a proper amp and  DSP.

I have yet to hear anyone listen to measurements when listening to a pair of speakers, therefore I really don't pay attention to them....

@erik_squires wrote:  "If the peaks and dips are not audible, as @audiokinesis suggests then I wonder why and how they went through all the trouble to introduce them in the first place?"

I think the up/down peak/dip jogs are artifacts of the enclosure design, which is apparently a transmission line/port hybrid.  There are corresponding little spikes in the impedance curve that look like what I've seen in some of my transmission line builds. 

If it measures badly and sounds good, it is good.

If it measures good and sounds bad, it is bad.

Wow, what incredible and original insight! Haven’t heard that one before. 🙄

The Alta Alyssa also seems to be radically oddly designed.  In the case of the Adam it's almost as if the designers have deliberately introduced some comb filtering into the frequency response, kind of a hard thing to do if you are paying even moderate attention in crossover theory class.

Perhaps the radically different response curves make the speakers sound more detailed and make the reviewer go through their entire album collection again to hear what they've been missing.... 🤢

Sorry, that's a bit of a cliche I read when speakers are deliberately ragged. If the peaks and dips are not audible, as @audiokinesis suggests then I wonder why and how they went through all the trouble to introduce them in the first place? 🤣

Seems to me the correlation between high end and cost is much higher than the correlation between high end and measured sound quality.  

If it measures “really badly,” then it’s not a high end speaker IME. All the absolute best speakers I’ve heard and owned measure exceptionally well.

I have zero doubt that these days I would be able to quickly hear the issues with that Alta speaker. 

A decade ago when I was much less experienced, it’s likely that had I auditioned that same speaker, I would’ve thought it pretty good. 

Probably not myself personally, but If someone likes the sound of an expensive speaker it does not matter that it does not measure well or technically may be poorly designed or implemented. The off base measurements will probably be an indicator of the particular unique sound that is liked and is less likely to be found elsewhere. In other words a poorly engineered speaker may sound unique and distinguish itself from others but the reason it sounds that way may not be a very good one.

Or one may just be drawn to a product by aesthetics.  You have to live with your speakers so looks matter.  It’s all good even if not so much technically.