If the transformer is not wrapped with low frequency high permeability mu metal sound quality will suffer. No two ways about it. The toxic effects of the induced magnetic field extends to everything within what, about a foot of the transformer? At least.
Magnetic field outside of toroidal transformer is theoretically zero. It is completely contained inside of the core. Toroidal transformer has no gaps making it more sensitive to presence of DC voltage.