@filipm it’s unclear to me what you tried with wifi? Did you physically unplug from the wall all your routers, access points, extenders, devices that receive and or broadcast wifi and Bluetooth? Turned off all mobile devices (including phones, smart watches, tablets, computers)? This will help identify the source inside your apartment. You said if you lift the unit up the noise reduces? This can mean your downstairs neighbors have some sort of a device that can produce this interference. There’s just too many things…smart switches, smart devices, wifi access points, etc
Also, how old are the tubes in the unit? It would be interesting to change the tubes to something like latest production JJs or Gold Lions. Since you didn’t experience this with your solid state phono stage, if you don’t find and can’t eliminate the culprit, one of the simple options will be to go back to a solid state phono stage.