Definitely start if possible with the that speakers you intent to keep for good. Build up the rig with the best that you can afford & don't try to cut corners / save $ by trying the cheaper stuff. I spent so much more $ by first trying to mid-fi economize, but was never satisfied until I started buying the good stuff & selling off the "bargains". If I had put more of the $ wasted into good equipment to begin with then I'd have an absolute killer rig today. It's still pretty nice now, but for the $ I spent along the way it could be that much better. Don't fall for "false ecomomy" it's much more costly in the long term.
What is your upgrade philosophy?
With at least 4 or 5 (perhaps as many as 7) components (plus cables) comprising the system at any given time, certainly one is the best at what it does and one is the worst, and the others in between. When you have the fever and spare cash, do you prefer to take the one weak link and vault it to the top of the pile, or would you for the same money upgrade perhaps 2 components to middling status? Seems the former yields a better system long term, but the latter would provide more immediate improvement. Is there a method to your madness?