There are a lot of variables in play, very few absolutes, and pros and cons with every choice. Freedriver touched on the fact that larger drivers become directional at frequencies that are larger than the surface diameter.
Implementation, setup, the listening space, phase coherency all play a large role in the outcome.