I've done Dirac room correction and both sets of speakers still bother me a bit. These are not bright speakers I know.
@wrecked Since you've done room correction the cause of the irritation may not be brightness. Higher ordered harmonics caused by electronics are perceived as the ear as harshness and brightness, and yes, can be enough so that you might get a headache.
The thing about that is the room can measure perfectly flat while this is going on. Since you already know the speakers aren't bright, if it were me, I'd be looking at the electronics. Solid state amps (in general) are well known for this (which is why tube amps are still around after 7 decades of transistors...). There are solid state electronics that aren't bright due to distortion.
So again if it were me I'd try a different amp and see if you get different results.