The mastering of the material and the DAC that's performing the conversion to analog matter more than what the source media is.
If I play a SACD on my Oppo player, it's not going to sound anywhere near as good as even a 44/16 file of the same song will through my streamer and DAC. The DAC in the Oppo can't come close to my DAC.
However, if I send the 96kHz data from the SACD, using the Oppo as a transport to my DAC, it will sound wonderful, provided it's well mastered. In general, SACDs are well mastered and intended for the "audiophile" crowd.