+1!!! My listening experiences and progression through the years mirror what you have described. Without question it depends upon the specific speakers utilized. Certain designs do require/ benefit from higher power output and current capability.
If the speaker is appropriate I find that I prefer the presentation and sound quality provided with high quality low power amplifiers (Particularly DHT tubes). There are numerous ways to achieve very satisfying sound quality via one’s audio system. Higher powered amplifiers as the better option by default is not a position I agree with. It depends on the specifics of the circumstances one faces.
Charles