To Float or not to Float...

I have a DeHavilland preamp which has a switch allowing one to "float" the ground.  I've always used it in the "float" position, however recently, perhaps due to some connectivity issues with my interconnects, there is a small buzz emanating from my speakers with the switch in this position.  The buzz disappears when I flip the preamp switch to the "ground" position.  Irrespective of the buzzing, is there any sonic advantage (or disadvantage) to "floating" the preamp ground in this situation??
Thanks for your informed opinions...