This subject has been brought up a number of times, and every time it is once again pointed out that many (most?) loudspeakers have their two or three drivers wired in opposing polarities. As an example, the midrange driver will be opposite the woofer and tweeter (Wilson's, I believe). Reversing the polarity at the pre-amp will result in each driver then being opposite of what it was. What remains constant is that different frequency bands are being reproduced by drivers in polarities opposite each other. Which frequency bands do you want in "correct" polarity? Wire your speakers (or flip your pre-amp control) so as to achieve that.
But as almarg said above, many recordings are themselves already of mixed-polarity, so what does it matter?! If you play a single-polarity recording through a single-polarity loudspeaker, phase reversal should be more audible than in the above scenario. Phase reversal of the Sheffield direct-to-disk LP's is more audible than of "normal" recordings, and many of the Sheffield's are themselves in reverse polarity (a snare drum strike creates rarefaction, not compression). Sheffield recommended the playback system polarity be reversed when playing their LP's.