The drivers matter but the room and integration do as well.
Even in driver manufacturing there's an issue of diminishing returns and questions about whether you can hear the difference between say a specific $500 midrange and a $50 dollar one. Money here is also subjective.
Having said that, I think Fritz repeatedly demonstrates what a good 2-way system in a modest room with proper mid-treble absorbers can do.
On the other hand, if you must rock, those excellent speakers with excellent parts won't fully satisfy you.