I think we (as in audiophile, studied listening) have always been a niche. When I was a teen into my 20s, listening was a social activity-- there was much less home entertainment to compete. Into my 30s and 40s, I participated in an audio club in NY but got to a point where had far less time to listen, and was not interested in futzing around with turntables and tubes (my long time systems, since the early-mid 70s). Home theater became an easy way to push a couple buttons and be entertained when I was doing so much traveling for work.
By my 50s, I got back into two channel audio and revamped the main system entirely. Now, in my dotage, I have the time and interest to continue this type of "studied" listening. I have met young people who are pursuing a similar course, though they have not yet reached their peak earning power. That doesn’t matter, it’s more a mindset and approach than money spent. But, without wide-ranging data, all I have is my anecdotal experience-- and believe we have always been in the minority (except perhaps in the ’70s, when hanging out and listening was a "thing to do" for our generation).