It is probably more a question of your personality. I use a high end DAC in my headphone system. I am sure the DAC can stand the wear and tear of being moved. My main system is 30’ from my headphone system (see my systems under my UserID) but I have two high end DACs, one for each. But, that is me. I am really lazy.
I’m pretty sure the equipment will be fine… and using the highest quality components will definitely enhance your experience in each system.