It puzzles me why the debate about measurement vs. subjectivity sometimes gets so fierce. Why can't we have both? I certainly want both. I appreciate that what we can measure may not represent the sum total of our listening experience. But if properly done it represents an accurate, objective characterization of at least one dimension of a product. It is better than nothing.
I like to trust my senses but oh how they can lead me astray! As several of you have said already in reference to your selves; I know that my listening reflects my mood, my physical state and many other variables. I liken it to wine tasting, some pretty plain wines can taste pretty great in the right setting, with the right company and/or the right food and vice versa.
At some point the differences get large enough that quality can be discerned fairly consistently. But much of the audiophile pursuit is just pushing boundaries a few percent or less at a time. That is where the really big money gets spent and ironically that is where data is almost never presented.
Lets continue to push for as much data as possible along with the knowledge to connect the numbers to our sensations; but meanwhile we all will also have to keep listening as well as we can. I follow Amir and the folks at ASR and learn some things there, just like I do here. When there is overlap I usually get more interested.