The preamp could pop if you are switching between signals with different DC offsets if there's no inter-switch muting delay.
Ideally, there's a relay which turns off the output, switches inputs and then enables the output. It takes some logic and relays and $$$ to do this so not surprised really.