S/PDIF is sensitive to the jitter of the source, though better DACs handle jitter in the source a lot better today than they used to.
Asynchronous USB however should be immune to source jitter. Assuming your streamer has relatively high jitter, a better streamer, or one that uses asynch USB would lower the jitter and potentially sound better.