Your comments are among the most relevant to the issue. Many pop/rock recordings, and other studio recordings, don't have genuine depth. Well-recorded orchestral recordings are perhaps the best for hearing depth, partly because there is more physical depth to an orchestra than to smaller groups.
I suppose you also have to have some level of quality in your electronics--there needs to be enough transparency to hear the depth clearly, and mid-fi electronics may lack that.