I'm currently listening to Qobuz on a Raspberry Pi 4 running PiCorePlayer. Power supply is the switching wall wart that came with the Canakit RPi 4. Total cost less than $100. USB connection to a Schiit Modi 3 DAC, driving a STAX earspeaker system.
It sounds very nice, with no noise that I can detect. I haven't tried it with a linear power supply, so can't say if that would be better, but it's perfectly fine as it is.