The crossover design is critical with both 2-way and multiway speakers, but it’s considerably more difficult to achieve balance and coherency with more than two drivers. If the objective is for the speaker to be able recreate a music wave realistically, with all harmonics intact, the wave has to have a consistent shape and amplitude, and the correct phase and timing whether it’s coming from one driver or multiple drivers....the more drivers you add, the more difficult it becomes to recreate that music wave and have it replicate the original.
Single driver speakers have appeal because of their simplicity and lack of a need for crossovers to shape the sound to reproduce a music wave. Their phase coherency is excellent, and they tend to have less smearing and latency caused by crossover components. Their downside is that when frequencies that are smaller in diameter than the driver, those small frequencies tend to beam straight ahead, and have poor off-axis performance. The larger the driver, the more beaming.
There is always a downside to every option, but the marketing hype leaves that part out. Thus opinions that are formed based on the same marketing hype tend to echo only the upside, unaware of the disadvantages. Making an assumption that more drivers are better, is similar to saying more salt is better in all recipes.