Karsajid, I don't recall if we've conversed on email - there are too many monikers to recall - but if not you're welcome to contact me.
I have used/reviewed Jeff Rowland, VAC, Cambridge Audio, Monarchy Audio, Pathos, and Coda among others with Legacy speakers.
With the mid'highs for the Whisper DSW I enjoy the Pathos Classic One MkIII; I am using a single Cambridge Audio Azur 840W on the bass. It is possible for you consider a different amp for the Mid vs. High level inputs to the speakers. It will take some playing with the options, and you can adjust the filters to your liking. The active x-over system is quite involved and will take much longer to achieve perfection to your ear than a regular speaker. However, the potential vastly outstrips a speaker with passive x-over. :)
Finally, if you want sweeter, warmer midrange seriously consider the Pathos, as it has one of the most beguiling midrange presentations I've heard from any of the amps I've used - that's why it's on my Mids with the DSW.
However, if you have not worked with the gain/filters of the XD for your current amps you may wish to do so prior to seeking new amps. I can discuss with you about that.