I did forget to mention it gets louder when I touch the tone arm so could be something else.Most definitely! The tone arm tube should have continuity to the chassis of your phono preamp. If it does not, hum is a likely result.
Is some level of hum part of an analogue setup or should it be absolutely quite?Hum is not part of the analog experience. You might get hiss but hum is an indication of a problem somewhere.