There is no doubt that removing the passive crossover will improve control over your woofers. Nobody argues against this. It is theoretically better. It is measurably better. And it is certainly audibly better.
In my own car audio setup, converting to an active crossover noticably improved the midbass and bass, but the tradeoff was a harsher midrange and top end.
I think that semi-active is the answer. In my experience, the low frequencies benefit most from going active. The midrange and top end, less so.