The "how many reviews it got" rule


This is my rule of thump when I purchase components online
without having heard them first.  If a component received a
lot of reviews, chances are the component is very good.
I mean the component has to be good to attract a lot of
reviewers. Most reviewers probably wouldn’t
bother to review something he doesn’t like in the first place.
andy2
Here is the thing, you give an item a bad review, and you implicitly insult people who went out and bought one. They get upset, regardless how spot on, or perhaps even generous the review, and they will not renew their subscription. Subscriptions plummet with every negative review, which also lowers advertising revenue because the advertisers want a large audience, and pay based upon magazine sales figures. 

When TAS and Stereophile were add free, they had more flexibility but still, their income stream was based upon magazine sales, but in their case, magazine sales only. So even then there was an automatic disincentive to degrade bad gear. 

I have owned and heard many of their top tier gear, and have found that much of it sucks. While I rarely ever buy based upon the clown posse's reviews, I thankfully did allow them to talk me into buying a Schiit Audio Yggdrasil, and that was a game changer, but it was also, I believe, an exception.

It was such a drastic improvement that I have since completely revamped my stereo. I went with a Schiit Freya for a time, but reluctantly followed the advice of a former Freya owner and bought a Don Sachs DS2 preamp. I honestly expected it to be at best a nominal improvement, but it wasn't. Mind you, synergy does come into play here, had I had say Vandersteen speakers, I may very well have been unable to distinguish many of the differences which I heard. 

So too with individual reviews on line. Ignorance is a part of the human condition, if not we wouldn't bother with reviews in the first place. The gear that I own is the most neutral I can find at a price that I believe that I can afford. Others would call neutral gear bright, and I suppose bright gear, very bright. So ferreting through reviews of any type is fraught with problems. It's a shame that we don't have audio studios strategically located throught the nation with large assortments of gear that we could listen to in a variety of acoustically different rooms.
Art Dudley used to extol the virtues of EAR gear. Then he reviews their latest Classic CD player and said it sounds terrible (for the price) distorted while Atkinson supports that view with measurements. Sure, it was defective, putting out 6 volts instead of 2 volts. He sends it back and issues an update that it is good and should be in the company of similar priced single boxed players. No kidding. I own the EAR Acute and heard a stock Classic. It’s a great player with the stock tubes even (mine had to have NOS Amperex). The forum trolls were merciless saying how junky EAR equipment is and how they should know better than making defective equipment because of the review.

Yes Inna, it does seem like a lot of cash for a similar sound but one can purchase a used EAR Acute (strictly for CD playback) for $2K.

Sometimes the magazines go crazy for new technologies but downplay the negatives. High Fidelity cables have never sounded good in over a dozen very different systems I’ve heard them in. Yes, they have patented the heavy magnetic cable implementation, the bigger magnets, the more expensive (and the worst sounding).

Sometimes they leave out the required synergies necessary to make something sound great. B&W speakers (as well as Wilson and Magicos) need a TON of power to sound as good as the reveiewers say. No SETs or typical amps without great current reserves for them.

Also, back in the 90s, a Counterpoint Amp was deemed mediocre by RH and returned to the manufacturer. They said they changed it. He then gave it a big thumbs up stating how good it is. Turns out, Counterpoint didn’t change anything and resent it to him. You can’t trust most magazine reviewers.
For audio reviews you have to re-calibrate what constitutes a bad review, it won't be the same as asking the advice of a buddy or someone on a forum. The term "damn with faint praise" comes to mind for poor pieces of gear.  The reviewer will typically point out a few minor positive qualities and say something like "careful gear matching is important." That's about as bad as it will get. 

I try to match up common characteristics across reviews, if 3 out of 4 reviews say that an amp has a wide soundstage then it usually does.  If all of the reviews say something different I become skeptical and take them all with a grain of salt.  
There are so many good component manufacturers that get little press/reviews. Some out of choice; others out of circumstance.

Take von Schweikert speakers or Daedalus speakers. Beautifully made and beautifully sounding speakers that rarely, if ever, make Stereophile - though do appear in Dagogo and other fringe publications.

Or Decware amps and speakers - which refuse to be reviewed by anyone except customers - and that informally.
The best sound I and all the critics in the past several years heard, were the Ultra 11 Von Schweikerts. I’m considering the VR55K at $50K-$60K for a smaller room than the showroom hall. How about the great sounding, efficient Lumenwhites, virtually unknown except at shows. Tannoys a big name but rarely do their big speakers get reviewed. These are companies with great, efficient speakers.