Best way to A/B two different streamers

I just did a shootout like this a few days ago.

1) Connect each to whatever inputs available that both support the source resolution for testing.

2) Stream the same source material with both concurrently

3) Compare. I’d use a sound meter or similar app to make sure both are same volume.

4) Pick the winner and on to round 2 repeating same test but with different input configuration as the challenger if available.

5) Repeat as needed until a winner can be determined from among all the available streaming options at your disposal. 

My recommendation would be to listen to the streamer for at least 3-4 days to get to know its sonic signature. Then switch to your computer as streamer. Spend another 3-4 days if the differences aren’t immediately obvious. Make a playlist specifically for this comparison. Make notes of what you hear. 
If you must use a switch to go between the computer and the streamer, still avoid quickly switching back and forth. Go thru the entire song with computer then the same song in its entirety with the streamer. But…in my opinion using the usb switch can impair the sound quality and you will end up making a mistake…potentially…

FWIW, In every comparison in my system, my mac mini could not match the performance of a dedicated streamer. I used Auralic Aries G1 and Lumin U1 Mini for the comparison (USB cable was Audience AU24se+).

Willy,

You’re getting some non-optimal advice here.  People are right that you should NOT use a cheap switch.  Nor should you use an optical on one and USB on the other.  Neither will provide a valid comparison.

Pick 5 to 10 tracks that you feel are very well recorded and that you really enjoy.  Be sure to include some acoustic instruments and vocals that you’ll recognize as sounding “real” or not.  Some complex rock is fine too.  Be sure to include some cymbals and kick drum or bass drum.

Listen to the entire group and listen for specific things on specific tracks such as cymbal strikes, sibilant voices, deep bass, transients, handling of complex passages, clarity, soundstage depth, width, specificity, etc.  Take notes on how “real” each track sounded and of course, whether you found it emotionally involving.  Did it make you want to keep listening a lot longer or did you find yourself wanting to do something else?

Then go through the same group with the other streamer, hooked up EXACTLY the same way.  Go through the whole process 2 or 3 times.

Quickly switching back and forth between pieces of equipment within the same track seldom tells you whether you want to live with a new piece of equipment or not.

You should also stream the same song at least three times in succession to ensure that your connection is good.

Pay particular attention to sound stage as opposed to frequency response. If it wanders with the streamer, get a better connection [NOT cable] or streamer.

I’ve had streamer demos where that was not the case.

IMO, PC streaming is not worth mentioning.

@willywonka so…anything to report? Winner? No difference?