Galvanic isolation isn’t a requirement for a balanced circuit.
True.
The transformer output, unless it is center tapped, is only differential, which is where the value is anyways as far as common mode noise rejection is concerned.
Yes, but it proves my point: The + and - are not necessarily referenced to ground. This is something which has just come about because we now use inverting op amps to drive the (-).