I prefer to advise edges first (speakers and source). But if I had to pick just one it would be speakers first - the last transducer actually creates the sound. Source is important, but if you can't reproduce what the source can provide then what's the point?
