I have a blissful marriage between my Aurender W20SE into the Berkeley alpha USB into the Berkeley Alpha Ref 3 DAC.
As other posters have commented, everything in the chain matters, high end switches with dedicated power supplies, proper Ethernet cables, and digital cables all come into play.