In my experience, the biggest changes come from power conditioning/treatment and from using systematic grounding devices and schemes (like the Nordost system). You don't necessarily need rack space for power treatment, a very good power strip (like those from Isotek) can do quite a bit to improve your system. Power conditioning and grounding devices improve soundstaging and clarify instrumental timbre without dramatically changing tonal balance (meaning sound will almost always be an improvement). Isolating platforms and feet also change sound a lot, but, because they change tonal balance, the change in that respect can be good or bad.
By far, the biggest change occurs when you optimize speaker and listening chair placement and do some form of room treatment. That does not necessarily mean buying exotic traps and panels--it could mean using spot rugs on the floor, tapestries on the wall, movement or addition and subtraction of furnishings.