From high end digital to beginners analog?

My son, who basically listens to mp3/ipod, bought a cheap turntable recently for his low end bedroom system. This intrigued me and greatly amused his friends! I have been thinking about a trying a relatively cheap turntable and phono stage for a few years now. Have not had one in 20 years.
Will a $2k to $4k turntable plus phono, new or used, be a waste in comparison to modern high end digital?
Has anyone had a recent dabble like this, and what where the results?