Humm from phono but not dc or aux ?

@analoghaven, when you say "faint RF", can I assume you mean you are literally picking up a radio station on your turntable input? It happens, so I don’t want to discount that is what you mean as that would be about the only way you now the noise is RF.

If you are picking up a radio station, probably an MM cartridge input? Hopefully you can fix that with a better shielded phono cable than you are currently using, but even that may not work if the cable is not shielded in the turntable, and next question will be is your arm metal or composite. (You can try putting twists in the wires in the turntable / arm if composite).

White noise as @millercarbon stated just comes with the territory of turntables, especially if really faint. If shielding does not fix your picking RF issue, you may need to replace the phono stage. It could be a defect (loading capacitor normally gets rid of RF), or a design flaw.

@analoghaven  - Can you please describe this "RF" noise you talked about. It is not clear.

I assume it goes away if the cable from the turntable is removed?

See my post above w.r.t. RF. You may be able to fix it by improving the wire in the turntable / arm, assuming  your other phono cables are properly shielding. If not, may be an issue with phono stage.