I'd say you should only spend money once you've heard a difference that's worth that much.
Is this a meaningful upgrade?
I currently use a Schiit BitFrost 2/64 DAC. I'm considering an upgrade. I don't have any specific complaints about it. I think it's easily the best in it's price range, like most Schiit products.
I'm considering buying a used Schiit Yggy as an upgrade in overall quality rather than a change in sound. It uses the same DAC chips but with higher quality implementation.
Is this a meaningful upgrade or just a sideways move?