I used to work in a recording studio, and I'll say that for the most part, yes the really high-end gear does make a difference, and most of the time that difference can be heard in blind, controlled A/B/X tests.
However---this comes with a huge caveat. In the studio context (at least in my experience), at least as much money went into designing and building the room as anything else. Non-parallel walls, bass traps, low reverberation, super-quiet air conditioning, etc. After that, as other people have said, speakers are probably where you hear the dollars most easily (and, in the studio context, microphones).
Second big caveat---although I said we could often hear differences in A/B/X tests, these differences were often *really* small and subtle, and frankly not anything I would ever pay for in a home situation. I think you hit the point of diminishing returns fairly early, actually, and while you can go on and pay 20x as much money for another 1% improvement (and the 1% is real), is it worth it? In the end it's up to you, of course.
However---this comes with a huge caveat. In the studio context (at least in my experience), at least as much money went into designing and building the room as anything else. Non-parallel walls, bass traps, low reverberation, super-quiet air conditioning, etc. After that, as other people have said, speakers are probably where you hear the dollars most easily (and, in the studio context, microphones).
Second big caveat---although I said we could often hear differences in A/B/X tests, these differences were often *really* small and subtle, and frankly not anything I would ever pay for in a home situation. I think you hit the point of diminishing returns fairly early, actually, and while you can go on and pay 20x as much money for another 1% improvement (and the 1% is real), is it worth it? In the end it's up to you, of course.