Let's see, the noise goes away when you turn off the preamp... Then unless you are using a tube CD player or tube DAC, your preamp is very likely inherently noisy, and the source of the noise.
If you are using a tube source component ahead of the preamp, then it could be that the source is the cause. Turn off the source component while leaving your preamp and amp turned on. If the noise goes away, it's the source component, otherwise, it's your preamp. The higher the input sensitivity of your amp and the higher the efficiency of your speakers, the more apparent the system noise floor will be.
Some tube preamps are just plain noisy. Changing to low-noise, low-microphonic tubes may help some, but could be wasted on other designs where the circuit design is fundamentally noisy.
Incidentally, if you had bothered to mention which preamp you are using and which specific source components, it would have been much easier for us to pinpoint the problem and make more specific recommendations.