Try the diffusers, and let us know what you hear. Generally speaking, I've read here and elsewhere that absorption is better on the front wall (behind the planars). I have tried everything from nothing at all, to slight absorption, to full absorption (but never diffusion), on the front wall.
The absorption does change the character of the sound, but I would describe it as more precise, more detailed, with better imaging. Without absorption, there is quite a bit of sound that bounces off the front wall, and distorts the precise soundstage. But it does sound "brighter" without absorption, so if your system sounds dull, then perhaps, no absorption will be better, although perhaps the musical imaging will be slightly more blurred.
Experiment with your ears, and find out what's best for your system and your room.