Once you reach a certain point, the room matters a great deal. I do not switch gear very often, but have moved several times in the last decade. In each room, the system sounded very different. Consider the difference the venue makes at a concert.
Most Important?
After speakers where do you focus the lion share of your funds. I known garbage in garbage out. Would you buy a really great amp and an ok cd player of vice versa?