I took the approach that volume should be carefully adjusted for classical music to match the live experience... and that perhaps that was also the correct volume for other music.
I had season tickets to the symphony for a decade, 7th row center. So several times I would go to the symphony and listen specific for the cues and pieces of music that were good for calibration. Something that started very quietly out of the silence and then noting the crescendos.
I found this useful for classical music. Of course the loudness varies from recording to recording, so there is not set place on the volume control. But I found this volume was often louder than I wanted listen day to day on other music. Not that it sounded bad, just louder than I wanted.