My experience is that speakers are what actually make the sound and so will define the sound of your system more than anything else. Find something you really love and buy it. If the rest of yor components don't match up to your speakers, fine. Take time over years and upgrade things piece by piece. With each upgrade you'll hear a world of difference. My example is that I had a pair of Vandersteen 2Ce. I loved them. I ran them with an old Rogue 66 pre and m120 monoblocks. My main source was a project debut carbon. When the opportunity arose I upgraded my speakers to Vandersteen quatro woods. This was a huge step up. It sounded better but my components were not letting them shine completely. Over the course of the last 5 years I've upgraded my amps to m180s, upgraded my preamp twice now to an RP-7, upgraded my turntable twice now to a Brinkmann Bardo, upgraded my phonostage twice now to a rogers PA-2. When things sounded not quite as stellar as I though they should Iade some tweaks that isolated my speakers and gear from the floor. It sings like I've never heard before. And truthfully, the speakers are probably capable of more.
My point, if I haven't successfully made it yet, is that go nuts on the speakers if you can. Fill the component gap later. You'll be increasingly happier as time goes by.