Can an audio rack be that important?

When we spend Tens of thousands on audio equipment are we losing sight on the importance of a good audio rack? I have seen many setups were ultra high end audio equipment is used sub-par equipment racks. 
I have been grappling with buying a high end audio rack for sometime but have always put it off as less important. 
What does a reference rack actually do for the sound of high quality components?