Audiophiles and apartments: Oil and water?

I live in an apartment, and am thus constrained when it comes to the volume at which I listen. However, I tend to view this as a glass-is-half-full kind of situation, because when I do have the opportunity for serious listening (when the downstairs neighbor is gone) I appreciate it that much more. How do you handle your situation in an apartment or other close-living quarters?

Tim