Should an audio system be left on at all times?

I've heard that it's generally a good idea to keep computers on at all times and that this improves performance as well as longevity. Does this also apply to audio systems? If so, does this apply to all components (amps, cd player, etc.)?