Reviewing the Reviewers


Check out http://www.high-endaudio.com/index_ac.html and follow go to the "Audio Critique" page, and then to "Reviewing the Reviewers" page.

This site is run by a man named Arthur Salvatore. He has written much about all aspects of audio on his site...his recommended components, his recommended recordings, his store, etc. He writes like a lawyer, but it seems like he actually has integrity...he must not be a lawyer. :-) Seriously...anyone interested in a point by point analysis of modern audio reviews should check out this site. He's analyzed many reviews and developed his own list of "rules" that most reviews tend to follow (and he's dead-on)...usually because the writer doesn't want to say anything negative about any particular sponsor's (or buddy's) product.

He received an angry letter from Michael Fremer. The letter and his analysis are included on the site. It makes for a long read, but it can be fascinating. Besides...it's information than every audio joe (or jane) should be aware of when they read any review...especially when they're planning on pruchasing a product highlighted by a particular review.

If you want to see textbook examples of his "rules" put into practice, just check out any Soundstage review written by Marc Mickelson.

Enjoy...
phild

Showing 5 responses by tubegroover

Djjd and Detlof, I think you guys misunderstand Mr. Salvatore. He is the Annointed One who holds the truth. In the truth is salvation for the misguided fools who know not better. There is no irony or hyprocrisy when you are absolutely right. Although I agreed in general principle with much of what he said, his rationalization about the motives of reviewers and their e-mail responses if not the magazines crossed just a WEE bit over the line. Especially when he goes on to name his OWN list. Talk about pompous and self-righteous.
Djjd I guess the air is indeed full of irony as you anticipated it would in your last paragraph. No surprises there given your attack on Trejla which sounds personal to me. All I read in Trejla's remarks was a personal distain for a particular writer and see little correlation with the points made by Salvadore who was basically presenting his case as objective truth and using hot buttons that most audiophiles would agree with. That is the irony and hyprocisy I saw. A self-appointed savior breaking things down and assuming a bit more than he let on.



Well Eldragon I myself am an existentialist when it comes to audio matters. This is a capitalist society we live in. And the way I see it, it kind of works something like this "Never let the whole truth get in the way of making a buck". We HAVE to be responsible for our own decisions. Why should we trust anyone to give us the whole truth. Call me a cynic, I say just pragmatic. Mr. Salvadore offers no surprises on his site. He just hit the hot buttons that we all suspected. One hand always washes the other. The rags are for entertainment. Yes we could expect more from them but my question is, ARE WE WILLING TO PAY WITHOUT THE ADVERTISING? Stereophile is in it for the money. It isn't that they lie to us, I don't see it that way. They just don't provide in their format enough information for us to make the best choices.

All Salvadore did was point out the obvious. My observation is that most audiophiles/music lovers are educated intelligent folks. I can't imagine too many that believe anything he states was a revelation. And just about all would agree with his points. As Slawney so eloquently states above (as usual Slawney, I do enjoy your dialogue and commentary on most matters), Salvadore has his own biases and preferences. The reviewers aren't the problem. They are just the messengers. Why shoot the messenger? They are just agents for the powers that be, the magazines and the BIG manufacturers. The problem is that the magazines do not compare products and attempt to give an unbiased comparison. Products are rated by price/performance not by absolute performance. There are many over achievers out there and the magazines don't point it out. My guess is that half the reviewers wouldn’t recognize it if they heard it anyway. All they need to do well is write and maintain a minimum degree of credibility.

The reason for cheap subscriptions is to boost circulation which increases advertising revenues. We think we are getting a deal when in reality all that is happening is the rags and manufacturers just get closer and cozier. At whose expense? Well hot damn, why would they want to do that? And now here comes Martin Luther Salvadore, the Great Reformationist. And what does he do? He starts shooting the messenger and then goes on to tell us the REAL truth. His intentions may be genuine but in every cult following there is too much absolutism which must be followed. And that is pretty much the way I read him, as Reprince says, a Zealot. If you want honest opinion and truth, you’ll get a better sense of it here on this site than any magazine. We all have a common vested interest. Here there are thousands, the rags only have a handful and remember, most are nothing more than good writers.

JGH “In who’s ears we trust”. Yes indeed Gordon, we certainly did.
I agree with much of what you say Detlof. However I think you underestimate how many people feel betrayed by the true motivations of most of the mainstream rags. It didn't use to be the way it now is. There was more integrity when there was little or no advertising. Sure the magazines need to make money and the mainstream ones make more than ever at least Stereophile does. I myself feel that it is a good value overall. You get good technical info on the products ala Audio. I do feel that their reviews for the most part are to the contrary of enlightening. They are so generic cookie cutter in their descriptions that you could easily apply one review to any other. Is this the fault of the reviewer or are there editorial lines that the reviewer must stay within? My guess is the latter. I would rather see more honesty in how they really hear and feel about a product and I seldom get a sense of that.

Of course they tell us to use our own ears and ultimately that is what we must do. The problem that I see is the allegiance that the mags have to the Major Manufacturers that get much more exposure because they advertise more. I find this very self-serving and not in the best interest of the readership or hi-end audio as a whole. They also do not compare products. There used to be more of this. This is one feature of the Absolute Sound that I really do like. Small manufacturers that can't afford to advertise may make it to the recommended component list but don't stay too long if they don't advertise. This is really a very calculated format issue that is more in the interest of the manufacturers than the readership.

And that brings us to the real beef I have and one area I totally agree with Salvadore on, their Recommended Component List. It is little more than a marketing tool to sell more copy and appease manufacturers', killing 2 birds with one stone. The readers seem to like it and the advertising is heavier than ever in those issues. I do not feel it is critical enough of the components that are selected. What with A+, A etc. Maybe I'm in the minority but I personally find it almost useless. I have listened to some of their “A” rated components and there is NO way that they should be included among the best, period, IMHO. Except I don't feel too humble in my adamancy on that point!!

The best parallel that comes to mind is the triad of legislators, lobbyists and voters. The legislators need the lobbyists to raise enough money to be elected by the voters. Yet they are often beholden to the interests of the lobbyists which may be at conflict with the best interests of the voters. The manufacturers need the magazines to get exposure for their products that the reader wants. The magazines are beholden to both their readership and the manufacturer. Satisfy both needs with the ultimate realization that by balancing both, they will make money. I feel the balance has gradually been moving over to the manufacturers and the readership has become little more than a commodity in achieving the primary goal of increasing the bottom line. Capitalism at its true essence. There is no reason to believe it should be otherwise. Your allegiance is going to be stronger to the customer that is the greatest source of your revenue. So can we "trust" a magazine to be completely honest in the interest of its readership? No we can't. All we can be is entertained and enjoy it for what value it does offer. And when those values becomes lost on the readership at large or if the market changes faster than the magazine can adjust to, they just go out of business.

And to the last point. JG Holt found the magazine on a principle that is still remembered by some. And it wasn't about making a lot of money. The magazine was established by an audiophile for audiophiles. Maybe it is expecting too much for things to remain the same but it appears that the ideals of this publication and its goals have pretty much been lost over the past 15 years. It sure is reminiscent of George Orwell's Animal Farm to me. A gradual shifting of allegiances in the name of Capitalism over Ideals. I will not use the word corrupt, a strong word and one not to use lightly. My final .02 cents on this thread.
Trelja, Howard Cosell WOW...funny how we perceive things. I always think of Trejla as thoughtful and considerate (sometimes to a (minor) fault). I have only seen his passion released as of late. Keep at it Trejla, I love passion and it has mostly gone with the departure of Carl.

Got a question for you and it has been really eating at me.
There was a thread a while back where the author was inquiring about SET's vs. OTL amps. YOU never did tell us which one you preferred. Being the tube afficionado you are, I myself was just curious. Which design do you prefer? Let me guess (I feel quite certain I am right from your posts but lets see) you are an SET man. Please tell ME!!