Example of a piece o’ crap, useless review


I’ve harped on how crappy and useless many “professional” reviews are because they lack rigor and omit critical information.  This one is from TAS that is a main offender of pumping out shallow/unsupported reviews, but most of the Euro mags among others are guilty of this too IME.  One key giveaway that a review is crap is that after reading it you still have little/no real understanding of what the piece under review actually sounds like or if it’s something you’d like to consider further.  I mean, if a review can’t accomplish those basic elements what use is it?  This review is so shallow it reads like it could’ve been written by someone who never even listened to the review sample and just made it up outta thin air.  In addition to failing on this broad level, here are some other major problems with the review:

- There is no info regarding any shortcomings of this “budget” turntable — everything is positive.  Sounds like it was perfect, ehem.

- There are no comparisons to another product in the same general price category or anything else.

- The reviewer doesn’t even share what equipment is in his reference system so we can at least infer what he may have based his impressions on.

In short, in addition to this review being so bad/useless for all the reasons stated it actually reads more like advertisement for the product than an actual unbiased review.  I can think of nothing worse to say about a review, and sadly many reviews out there are similarly awful for the same reasons.  Sorry for the rant, but especially as a former reviewer this piece of garbage pushed all my buttons and really ticked me off.  What say you?

https://www.theabsolutesound.com/articles/sota-quasar-turntable-and-pyxi-phonostage/

soix

Reviewers almost never give an actual bad review because they know if they do that, manufacturers will stop lending gear for evaluation.

@roadcykler Actually that was not my experience. Over 17 years I only wrote one negative review, and I was not opposed to writing more if warranted. The thing is, for a product to make it to the level of getting a review among the thousands of products out there it needs to have some positive and usually even some special buzz about it. So almost every component that gets reviewed has been well vetted by many users and others so bad sounding equipment just never tends to even get reviewed. In short, the system self selects very good sounding gear right from the start. Also, the major manufacturers know what they’re doing, and it’s almost non existent that something they’d release to the public sounds bad. So this is really why you rarely read a bad review.

That said, that’s where the “art” of reading between the lines in reviews becomes important. Unlike the crappy “review” I mentioned in this thread, most good reviews will include a paragraph or two near the end just before the conclusion (that’s where I always put it) where a reviewer will elaborate on any shortcomings/limitations or qualities that he may have alluded to during the review that seem a bit off or things the reader may want to hone in on while listening or comparing to other equipment. THIS IS CRITICAL INFO SO READ IT CAREFULLY! So, while the product overall may be very good, these would be the potential “negatives” that the reviewer feels are important to highlight but they’re not nearly enough to trash the product and throw the baby out with the bath water. This again is why product comparisons are so important because these potentially aberrant qualities can be analyzed on a relative basis versus another known product and provide a very useful perspective on any potential issues. Also, reviewers aren’t all-knowing oracles and what we may think is a shortcoming for our system/tastes may well not be the case for many other potential customers, so better to just point out what we heard objectively and let the reader decide if that’s something they’d still like to explore further. Last, most audio manufacturers are not rich and do what they do for the love of it and many others might be relatively new, and a bad review could literally sink a company. Now, if the product outright sucks so be it although it’s highly unlikely that product would’ve made it to review anyway as mentioned above, but if a product isn’t perfect yet shows some promise as a reviewer you’ve gotta weigh the extent of the shortcomings and if they’re bad enough to potentially put the company out of business. So there are many things to consider as a reviewer. I wasn’t on the business end so can’t speak to manufacturers threatening to not send any more gear if they get a bad review, but I never heard of anything like that although it may happen. Anyway, I hope this sheds a little light on why there are so few negative reviews. It’s really not a conspiracy in my experience.

Reviewers almost never give an actual bad review 

I somewhat agree, however it is common for reviewers to pick and choose which products to evaluate, often these products are at least average or above- that’s a major reason why fewer negative reviews. The companies chosen are somewhat established so have likely learned lessons on what sells in their market segment.

I wholeheartedly agree @soix  with the “usefulness” or lack thereof some of these reviews.  Comparative analysis to similar products and the reviewer’s audio chain helps us to determine “value” of the product, without such comparisons we have no reference other than if the reviewer subjectively liked the product or not which is useless.  

Often, we have to read between the lines to derive a value judgement.  For instance, in HiFi+ review of the Siltech Classic cables here, the reviewer seemed surprised “…first note on the page was “Why haven’t I used Siltech Cables more often?”  and “net an extremely neutral and exceptionally detailed cable series. The ‘nothing’ part is just how good that sounds beyond that.”   I purchased a few  of these IC as I wanted neutral uneditorizing cables and the price seemed fair and within budget.

 

"Transfer functions" of various cartridges, tonearms, etc?  Please define.

Reviewers almost never give an actual bad review because they know if they do that, manufacturers will stop lending gear for evaluation. Even things that make no objective difference like cables or tuning dots or any of the myriad other things that do nothing get high praise. 

It’d be nice to see the transfer functions of various cartridges, tonearms, etc. It could be measured, and could provide some clues about what kind of sound to expect. I’ve owned different turntables and cartridges and some of them sounded very different for sure, much more different from each other than comparing different digital devices.

You know, it could be possible to make a device that wiggles the needle in a very precise way, something that’s not a spinning vinyl disc that drags the needle through its grooves. Now imagine if you used a digital source to drive the needle wiggler, and now you hear the music coming through your cartridge, tonearm, and phono stage, with all the associated coloration. You could even get nice thumps coming through the speaker if someone jumped too hard on the floor. The only thing missing would be the rumble from the spinning platter and the wow and flutter from the warped record. But that could all be simulated. This would drastically reduce wear and tear on the needle.

Given true long format reviews typically take six months to do. It is really not that surprising that each issue could only contain a few of these. Do the math.

@ghdprentice I can’t speak for TAS, nor would I care to, but at Soundstage we had three months to complete a review. I used to use the first month for break in and initial impressions and the next two months for critical listening evaluation and writing up the review, and that was sufficient time IME.

Out of curiosity, of the full format reviews how many provided a comparison to a competitive product? I’m gonna guess none and will be shocked if it’s higher than that cause that’s just not how they roll. Much quicker/easier that way although much less informative and useful IMHO.

Dear siox -- So what do you think of John Mendelsohn's review of Led Zeppelin I in the March 15, 1969 issue of Rolling Stone? Well over a half century ago, I read printed reviews of new albums and audio equipment in an attempt to enhance my music listening enjoyment. Some reviews were informative, some seemed to be page fillers, and some seemed to simply be a platform for reviewer biases. Take a deep breath and exhale. Enjoy the music.

 

Having given it a little more thought.

 

I would not call it a review. More of a quick note that the table exists and may be worthy of further investigation. An information note.

I flipped through the most recent edition. There are full format reviews (under the heading of xxxx Focus) on a number of the components: Burmeister turntable, Vandersteen speaker, Magico speakers, and some others. These all contain sections on associated equipment, and are in depth. The “reviews” in between in depth Focus reviews look like an attempt to cover more equipment. With the hundreds of components, there would be no way to cover them all in depth. So, it looks like a way to say something about more.

 

Given true long format reviews typically take six months to do. It is really not that surprising that each issue could only contain a few of these. Do the math. 

@jhnnrrs @aolmrd1241 I can’t speak directly about the other sites, but having written reviews for Soundstage for 17 years I can tell you that all they strive for are thorough and honest reviews, and BTW they have a site dedicated specifically to “budget” gear (Soundstage Access) so they don’t only review “uber high-end” equipment. Over all those years I was never told to write anything other than what I heard, and all of what I wrote always made it to publication without any alterations (other than some light editing) whatsoever. Furthermore, to ensure the reviews were as useful/rigorous as possible all reviews had to contain a relevant comparison section, and if you didn’t have a comparable product on hand or couldn’t get something you didn’t get the review, period, and all the equipment in the reference system used during the review was always fully disclosed at the end of the review. All this put together makes for what I call rigorous and credible reviews that are likely trustworthy and well worth reading and using to help decide which components are worth pursuing further.

After writing and reading reviews for many years it gets pretty easy to tell which reviews are more objective, thorough, and honest and which are more useless, superficial fluff so just dismissing reviews out of hand because the site uses ads will block you from a lot of truly useful and helpful information that is out there. Some basic tells for me is if the reviewer compares the review sample to other product(s) to give some critical perspective on the sound, the reviewer shares any shortcomings/limitations and/or unique sound signatures the product has (they all have them), and the reference system is fully disclosed. There are some good reviews that may miss some of these, but if any of those elements are missing I consider it a red flag and read with a jaded eye. Last, you can kinda tell just by the way the review is written whether it’s by someone who really did the work as opposed to a guy who just throws out a bunch of generic platitudes. Sorry to drone on, but that’s my approach to it and I’d encourage you to seek out those good sites/reviewers rather than throwing out the whole bunch for using advertising or because of some bad apples out there. There is some extremely helpful and informative info out there if you have the time/patience to uncover the gems. Again, FWIW.

All reviews and reviewers exist to sell product to their followers ... Either through advertisement fees...or dealers looking to make a profit hocking their wares...Pretty simple huh?

@soix I disagree with your assessment of the sites you mentioned. I find them little more than advertising media for uber-hi-end equipment and useless, expensive audiophile jewelry. Any site that devotes two thirds of its viewing space to ads (the ones with ads running down the left and right borders) is unlikely to post honest "reviews" for products that subsidize it.

I much prefer comparative reviews. The British What Hi-Fi mag did(does) it. I always enjoyed Car magazine's shootouts of similar class cars.

Most all reviews are now Infomercials.

@yesiam_a_pirate I actually somewhat disagree with this. There are many publications out there where reviewers are passionate about conveying honest and useful information for readers in their rigorous and thorough reviews. Unfortunately there are also many where profit/attracting eyeballs takes precedence over review quality. The key is to identify the more credible sources/reviewers from the hucksters/posers. Here’s a list off the top of my head, and in no particular order, of publications I read and find provide mostly credible and useful reviews…

- Soundstage, 6 Moons, Part Time Audiophile, Positive Feedback, Enjoy the Music, The Audio Beat, Stereophile

FWIW.

As someone who’s first TAS issue was #4, I am also frustrated by the extremely variable quality of their reviews. Some of the most profound things that a few of their newer reviewers will say is “it made my toe tap.” Ok, at least you didn’t go running from the room. Reviews are more of a description of music played than anything about what the unit sounds like. And lots of inexcusable and amateurish shortcuts- using the pre out jacks of a cheap integrated amp as the sole source of driving a multi thousand dollar amplifier under review is a sorry excuse for reviewing. 

I thought TAS lost their objectiveness with the MQA shilling. It was a sell out. It made me think of Julian Hirsch and his rejection of dynamic measurement (SID and TID).

One final rant- their recommended lists are ridiculous. Very little meat in the categories where most readers are: building sub $40K systems.

I agree that this product deserves a better, more comprehensive review and a performance comparison with other TT's in its price range. The review was vague and bordered on a fluff piece, but each reviewer has his own style and ability. TAS has had quite a turnover in its review staff; some you will like, others you will not.

TAS and Stereophile (to a greater extent) have  been changing their editorial approach in the attempt to attract a younger demographic. Personally, I don't like the writing style of the new crop of journalists. However, at the same time, age is a major existential threat to audio. Just go to any hi-fi show and look at the attendees - predominantly male, over forty and usually a fair bit older than that. The high end depends on people coming from entry/mid level hi-fi, so if younger people are not coming through that is a major concern - and not just for magazine sales.

I will read them because I like hearing about new products on the market, but would not buy something without a demo in a store or at a trade show.  To me, the music reviews are the worst.

soix

Sorry for the rant, but especially as a former reviewer this piece of garbage pushed all my buttons and really ticked me off.  

Are you often this excitable?

Soix, Did you write a letter to TAS complaining about the quality of this and other reviews they publish? 

@lewm Yes.  A while back I wrote to them about these issues but not surprisingly didn’t hear back, and obviously nothing changed.  I’ve also spoken to a couple of their reviewers and they both spouted the same company line that product comparisons aren’t useful because it’s unlikely most readers own the exact component used for the comparison.  This is just an absurd rationale used by them to try to excuse themselves from the considerable amount of added work it takes to do comparisons and the inherent accountability that it brings upon a reviewer — much easier/faster to just wax poetic about what you think a product sounds like in a bubble with no check and balance of a comparison.  One of their reviewers said he’d consider doing more product comparisons in the future, but I’ll believe it when I see it and not holding my breath. 

Reviews are full of crap, i.e. you have to dig thru it to get to the earth.

I just re-read the Cayin review I posted above, and I had forgotten my impression then: "it seems he is paid by the word". When I find a review that seems helpful, I read it a second time, skipping the extra and finding the meat of it, like I now remember I had to do with this one.

I am supposing I found other sources to help me decide, but this is the one I remember, probably the opening and closing lines.

I wanted a tube amp with remote volume, it had to sound as good as my Fisher 80z 30wpc mono blocks or I was going to re-sell it. Luckily, happily the Cayin does. I didn't even know Cayin existed.

@soix 

 

I agree with most of your remarks about reviewers in general, and agree that this particular review: 1) does read a lot like ad copy, and 2) has no comparator which would be useful to a buyer.  This is not, after all, an entry level or budget table, and if you add the arm cartridge, probably a $5K investment, which might be chicken scratch for some here but probably 5 times more than what most people will spend on audio their entire lives.  And of course no measurements, per TAS policy, which would have been particularly useful given the speed stability issues raised here.

  OTOH…I have heard the SOTA tables, and when he finally does get to describing what records sound like, imo he conveys that it’s strength is Pace, Rhythm, and Timing. SOTA is based in Delevan , Wisconsin, about an hour from where I live.  We have a recently widowed friend who has a summer home there and we have spent a few weekends there, and I’ve wandered into a local audio store a few times, with several SOTA tables on display.  I probably know the SOTA sound better than most other brands as a result, and perhaps that is why I get what he is trying to communicate.  I don’t own SOTA tables but wish them luck in the marketplace 

  In general the reviewer seems to be staying away from the usual audio terms which serves as shorthand between aficionados.  The review in general seems aimed at younger newbies, perhaps a conscious attempt by TAS to capture younger audiences who might view audiophiles of my vintage as old stale and boring.

  It would be interesting to see if that trend continues with TAS and other magazines, to see if they continue to consciously reject the culture and terminology that they helped create and try to lure younger blood.  I don’t intend to read them but I applaud your Watchdog efforts monitoring the B.S. meter

the opposite is a review that truly helps you decide. I never heard of Cayin, one used AT-88T on eBay: read this, bought it, couldn't be happier

https://6moons.com/audioreviews/cayin/a88t.html

 

Soix, Did you write a letter to TAS complaining about the quality of this and other reviews they publish?  That would be more effective than blowing off steam here, which is not going to have any effect on them.

The type of review you are looking for might be over the head of the majority of people looking to buy a TT at this price range?

@bigtwin Uh, what??? This is a $3000 turntable without a tonearm and cartridge. In what world does a product at this level not deserve a full and thorough review? Further, I don’t care if it’s an entry level Pro-Ject turntable or an AudioQuest Dragonfly, any product deserves a better effort than this piece of shite no matter what the level of the reader. This thing is utterly useless to anyone. @ghdprentice nailed it when he called this more of a description than a review. TAS has no shame and they don’t care, they just want to crank out “reviews” with as little work/time as possible to keep those ad dollars rolling in. Why bother with all those pesky product comparisons or listing the equipment in the reference system? Takes too much time!  Just throw it out there half assed ASAP. Waste.

Yes, that was a grossly abbreviated… more of a description. Not a review. 

Post removed 

That SOTA was one of the few things I have bought sight unseen and was surprised at really how good it was.   I did a little homework, demoed a few locally but I thought the SOTA was the best bang for the buck.    I don’t buy things based on reviews,  I like to “review “ it at home and let my ears decide.  
 

It is nice to have an idea of what a product’s level of quality and performance is and that’s why I like reviews.   A balance of specs, features, maybe some plots is good 

It's a beginner looking turntable at an above beginner price, if you equip it like the review sample.  Also, "I did notice that a record brush slows everything down considerably, which was a minor annoyance." That ought not to be happening with the Roadrunner/Condor/Eclipse motor system up and running. Something is off.

There are lots of people out there that do not have the in depth knowledge of an  "audiophile".  Is it possible you are not the target market for this review, and most others?   The type of review you are looking for might be over the head of the majority of people looking to buy a TT at this price range?  I suspect the folks on this site are in the minority and the audio rags are writing for the majority.  But that's just a thought from someone who does not identify as an Audiophile.  I'm just a simple lover of good music.  Cheers.

I totally get how it reads like an ad campaign and not a review but I bet it is a great table. 

@oddiofyl You know, and that’s exactly the point.  I greatly respect the brand and am genuinely intrigued by the design, which made this even more disappointing as the review gives me absolutely no clue as to why I’d want to pursue it further based on its sound characteristics and capabilities.  Absolutely useless and sad. 

The table in question is the follow up to the Escape.   It's basically an Escape with a nice wood cabinet instead of a resin.   Too bad they didn't elaborate on its performance because if it is anything like my Escape / Origin Live Silver , it should be on your short list in this price range.  

High quality motor made in USA with the excellent Condor motor controller.  Sapphire bearing,, high quality spindle and platter.    Definitely worth a look.  

I totally get how it reads like an ad campaign and not a review but I bet it is a great table. 

I don't even read reviews and have another (higher) level of abhorrence for youtube reviews. 

@carlsbad2  Amen to that.  There are a few decent ones that I’ve seen, but the vast majority are just posers who get off on talking into a camera and garnering eyeballs — depth of knowledge/experience and/or quality/depth of content be damned. 

Happily i almost never  read reviews anymore...

i just look at this one and i concur with soix... 😊

Post removed