I agree for the most part. Listening at the right level is definitely the best approach. As my system has improved, my ability to hit that level and not be fatigued at all has been one of the greatest achievements I’ve had in this hobby.
However, sometimes, I have to drop the decibels (for work, for family etc.) and I still enjoy listening. Of course, I can’t wait to have a chance to turn it up another time.