I have used a Dynex component video switcher, model no. DX-CVS4, to switch between line level audio signals. It has four sets of inputs and a remote control. It works just fine, even though it doesn't have the requisite four-figure retail price demanded by audiophiles everywhere as proof of quality. ;)
Since you have an iPod and a DAC, you might want to consider, as an alternative, getting one of the iPod docks that can bypass the iPod's internal DA converters and will allow you to run the iPod into the DAC.