What is more important is that BOTH speakers are wired with the same polarity. You would be surprised at how many speakers are shipped with mismatch in polarity.
Polarity of speaker drivers
Many speakers do NOT have all the drivers aligned in the same polarity. This is seen on many of the stereophile speaker measurements. In certain designs, I guess this is done for better summing of driver output. Is the time domain compromise audible?