Which portable audio player supports the most digital formats?

Hi all,
I've got a couple thousand audio tracks that I'd like to leave in their native formats, which are diverse:
AIFF
Apple Mpeg-4 Audio
.amr
.opus
mp3
WAV

But I'd like to listen to them on a portable device.

Does anyone know a portable device (on a budget) that covers all of these audio formats?

I'm looking for the VLC-player of portable digital audio players.

Something a bit older would be preferred, used. I'm only looking to spend around $50 here.