I think it depends on the level of sound quality you are going for. If it is the highest you can achieve, always leave unnecessary controls behind. They add signal path and lower the fidelity. This is why audiophile level equipment generally have one button and no potentiometers. On/off.
