Update: wrapping a faraday blanket over the unit dampens the sound. But the source of the RFI is not from my apartment, because it happens with everything in the apartment unplugged and off.
Does this mean all tube amps will do this and I'll have to go SS?