Do you spend more time analyzing the sound of your system, worrying it could be better?

I have an ARCAM AVR 550, Paradigm Prestige AVR, BlueSound Node 2i, OPPO 105, two REL SHO's.  I have a dealer that would sell me a brand new Luxman 509 for $7,000 ($3,000 off).  He would also sell Focal Kanta 2's speakers for $6,000 brand new.  The reason why I purchased the ARCAM was to be able to watch TV and movies through speakers.  I have not added the rear surround speakers yet because my wife won't allow me to buy them.  I thought at the time the ARCAM was more audiophile quality than the large Murantz I have in the family room.  I have been thinking of adding the Luxman to my ARCAM for 2 channel listening.  However, is it better to upgrade my speakers to the Kanta's.  When I first started I listened to Focal Aria's and even the 848's lack bass.  I think my REL's would fill in the bass now.  Who do you believe?  What makes the most sense.  So far, the majority in the group feel spending money on the source is better than adding speakers.  I have always thought the opposite.  What ever I do, when upgrading my speakers, I will be searching for the most efficient.  This group is certainly knowledgeable.