How can there be such a thing as a speaker that is too accurate? The goal of high end audio is to present the music exactly as it was performed/recorded. Of course this is never achieved in reality. At the end, we all have our personal bias as to what we want to hear. Like it or not, that is distortion.
No one here is really in pursuit of perfection. We want to hear our preferred version of deviation from reality. That is why so many spend large sums of money in pursuit of an unachievable goals. Me (not speaking for anyone else) have jumped off that wagon and convinced myself that at my skill and hearing level, I am happy with my modest system. It is so much better than what was available to me in the 70's that I no longer feel the need. Laves me a lot of disposable cash for other fun stuff.