I've seen this happen with both solid state and tube electronics, it's more a function of source volume and a combination of selector switch and circuit design.
Some very high quality and high performance equipment show this trait under certain conditions. If you want the best performance, disable all but the prime source for serious listening.
In some cases dumping the tuner and / or CD player during vinyl playback makes a pretty big difference.
