I'm not familiar with your specific listening standards, but to avoid harshness in the high frequencies, I found it necessary to remove the whizzer cone. The whizzer tends to exaggerate the treble, especially when paired with certain tweeters.
In this setup, I integrated a Fostex tweeter for better high-frequency performance. Using an RTA program with measurement microphone, I confirmed that the whizzer cone was introducing too much energy in the upper range, which negatively affected the tonal balance. Removing it resulted in a much smoother response.
@bache We're on the same page with whizzer cones! They are far more likely to have breakups of their own. I tried to find a version of the driver that didn't have one but as you know, to no avail. I don't play those speakers very loud and my crossover rolls the highs out of the Tangband (to help keep a nice impedance curve) but I've not had the guts to go after the whizzer. How do you do it? That strikes me as very easy to make a mess of it!