Everything matters in delivering the audio signal the ears. Components matter, so do the power supplies in those components, and the quality of the capacitors and resistors, and the type and quality of attenuators, and the hookup wire used to connect everything. And we have to include the quality of the connectors, as well as the type of wire used and the design of the cables. This is a chain and every link matters. Some more than others, but none can be discounted as not mattering.
It's not a matter of whether something works or not; it's about the effect it has on the end result.