While I think solid construction is important, another sometimes overlooked thing is keeping the speaker from moving in 3 dimensions. A woofer can make the whole speaker rock back and forth. YMMV of course depending on the mass of the speaker, but a cheap tweak is often simply to add mass to the top of a speaker.
Tall skinny speakers benefit the most. It's pretty amazing.
Best,
E