for me a nicer switch made a difference, but as part of a more extensive setup with various items helping with noise suppression, improved clocking, and superior power management -- the switch was but one element
that said, i would say that for most, the improvement the switch brings is fairly subtle, and thus one needs a pretty sensitive ear and/or highly resolving system for the difference to be quite apparent
if one cares to dive into the details of what matters and why it matters ... watch this... dry delivery, hang in there, it is an excellent explanation and quite complete in covering the relevant bases