Maybe we have changed over the years? At an earlier time, our musical experiences were more social, shared, and engaging. No "sweet spots", just good sound (and good friends) anywhere, and everywhere.
Placing gender differences off to the side for now, I think there are critical elements required in a fully involved musical experience. 1) Music appreciation. A more than casual approach to the experience where we get up close and personal with all the musical elements that produce the masterpiece in front of us. 2) Patience and discipline. It’s a bit of a training regimen to sit thru entire performances/album sides and discoving the "deep tracks" that didn’t get much (if any) air time. Listening to things that are familiar is quite enjoyable on many levels. Discovering unfamiliar tracks is a different endeavor altogether. So, "Side B, Track 4" wasn’t the the moment when all the stars lined up and the musicans came together and produced the best performances of their lives. But, they were trying to communicate something musically and we were there with them to listen, and appreciate the effort. It takes more than a few listening sessions to "be there" comfortably with music that doesn’t move us, or on our Top 100 playlist. Asking those around us to appreciate those things may be a bridge too far in building a bond between you, the music, and a guest.
I know women who love music more than men. They just want to feel free from physical and mental constraints associated with "the audiophile experience," They enjoy being fully engaged and resonating with their environments. This often involves more than the musical performance itself.