How come I don't hear of more people doing that?One reason is that the sounds from the two speakers are unlikely to arrive at the listener's ears with proper time alignment. That will result in comb filtering effects, which can generally be expected to result in a loss of clarity and resolution.
Regards,
-- Al