It would be so wonderful, and money-saving if OP's hypothesis was true; but the fact that many of us have known through personal experience for many years is that while a very good speaker will certainly show its worth with an average or even below average amp and source, it's true greatness and personality will only be exposed by a better source and amplification.
I recall many years ago, John Atkinson was reviewing a small monitor, maybe a Celestion, and at some point in his reviewing process , he used a Mark Levinson 23.5 (I think) to drive it. He made the comment that he wished everyone could hear and understand what a difference a really fine amplifier could make to the performance of even a modestly priced speaker. Through my own experience, I agree.