Just a technical note - the ultrasonic noise is quantization noise from the 1 bit sample size, not noise from aliased images.
From some of the graphs I've seen of the noise shaping for DSD64 it starts to rise right around 25 kHz. Nobody is going to hear that as much as they try.
Here's a way to test the upper limit of your hearing - Audiocheck Extended Online High Frequency Hearing Test. Note that you'll experience aliasing if you use a NOS DAC or a DAC with a 'leaky' low pass filter.
Here's a test to see what upper frequency limit you can reliably hear - Audiocheck Blind Testing a 16 kHz Upper Hearing Limit. You can change the target frequency using the links at the top of the page.
If you're curious, check out this example of dynamic range, dither, and noise shaping.