Maybe neutral is how relaxed you are while listening. Like your brain is not working overtime to interpolate what you are hearing into what you would like to hear. That would make "neutral" as individual as the listener. Applying science to art never seems to work out anyway, for just that reason.
