I tend to favor porchlight’s suggestion that the fault is in the selector switch, because OP says it doesn’t happen with other inputs. on the other hand, if the stereo/mono switch is only in the phono stage circuit, in that case it could be that stereo mono switch. But I think most of those old receivers and integrated amplifiers would have the stereo mono switch in the line stage circuit.