As long as the ground wire is not touching the cold side of the RCA connector, the signal is still "balanced". It's how you wire it not what connector is used. An XLR connector has 3 pins: hot, cold, and ground. If you use RCA, the shell is cold and center pin is hot and the ground wire is, well, ground. With that in mind, you can wire however you want or use XLR adapters. If you want to keep the entire signal path BAL all the way to the power amp output then you need balanced circuits in your phono stage to line stage to power amp.
.