It looks like you either connected them out of phase (plus (RED) to minus (black), and minus to plus) which will do no damage, it just may sound a little thin; or you connected the left channel to the the right speaker, and vise-versa, which is OK also.
If you connected one speaker in-phase and the other out of phase, some sounds will just cancel each other out (in the air).
This is OK electrically also, it just won't sound right.