Listening in the near field won’t really work as you’ve already found. I’d move the listening chair(s) back four feet or more if possible and toe the speakers in only as much as you need to get a good center image — just experiment but this should help.
Speaker set up for more than 1 person
I have my system set up perfectly for a single person sweet spot. Near field about 9 feet from my speakers. But if I move even slightly off center the soundstage moves and one of the speakers dominates. If I have a couple friends over how can I arrange my speakers so we can all get a good soundstage with centered imaging? Move my speakers closer together?