I owned a Sim Moon 650D DAC/CD player ($8.5K) and after a couple years added their separate power supply 820 ($8.5K)… to me totally worth it. The new power supply replaced the internal one. I quieted the output, enhanced resolution, improved sound stage. But each decision has to be made on an individual basis.
If your component has a wall wart power supply… then perhaps trading in and upgrading the unit might be more cost effective.
A few years later I replaced both with a single $17K unit. Huge upgrade… but completely different sound and the right move for me then.