If you have a foundation (room, gear, power delivery, etc) that puts you above a minimum threshold of satisfaction, there is a lower chance of rabbit hole surfing and getting caught in the weeds.
The human ear likes to be in certain types of spaces/rooms (w/ pertinent treatments) as a baseline to enjoy music. When it isn’t there, you are inside a rabbit hole, to begin with and will continue the rabbit hole diving..
W.r.t gear, if you heard some guy’s rig that blew your mind (acquire some points of reference), ask him how he got there, look at his room, look at his stuff, etc and make life easier by reducing the number of gear permutations. Discard brand loyalties (whatever is the forum hype train for the month), preconceived notions of which brand gave you more audiophile street cred, etc and try to keep an open mind.
In general, there is a correlation between a higher level of listening satisfaction and the physical size of things. Typically, it will come from large rooms, large speakers, subs, etc. Life is large dude... If you can’t get to that, i.e., stuck living in a tiny apartment with a speaker the size of a coffee mug, other waf restrictions, etc, just lower your expectations and find additional fun hobbies.
A mindblowing rig+room doesn’t care much about "test tracks". Just listen to the type of music/artist you like.