A friend and I used to have a bit of a "cottage industry" upgrading crossovers in vintage, and not so vintage speakers. This was back in the late 90’s and 00’s.
Even if the speakers were engineered well (reasonably flat response, no major phase issues at the crossover between drivers, etc), upgrading crossover components, i.e., better caps, replace iron core inductors, replace sand cast resistors. This was at least 2 decades before Danny’s videos and upgrade kits.
We also added bracing when needed
Our findings were almost exactly what Danny has found.
I also believe there are certain aspects of speaker design and implementation, that are not a matter of "voicing". If there is a hole in the response, especially if it is at the crossover point, that is simply bad engineering.
If the spectral decay plot shows stored energy, that is distortion, and a sign of poor design and implementation.
My friend and I didn’t have the ability to do spectral decays when we were upgrading speakers, but we could easily hear the improvement after we added cabinet bracing and used one of several methods to dampen resonant enclosure panels.