I'm a 2-channel guy. My system is set up such that none of the HT gear is in the chain when listening to music.
I don't have room for floor standers in the rear. I do, but the location would be less than Ideal.
Did you buy the B&W rears? You could try an inexpensive option and see if you like it. B&W floor standers seem expensive for rears. IDK. I'm not a home theatre expert. Tonally matching the center channel and mains makes sense. I'm not so sure about the rears. There isn't much dialog going on in the rears.
I have two REL subs in front and a larger SVS in the rear. The SVS only runs when doing HT.