Torn between two amps

I would like to use two different amps, but not at the same time. My Cary Rocket 88 sounds better with CD's and my custom OTL amp sounds better with vinyl. I am not sure the best way to hook these up in my system. I do not want to be switching I/C's and speaker cables every time I want to change source.

This is what I thought of but not sure it's the best way;

1.) I did a quick check on the web and saw a Bryston speaker switch box. Thinking I could run the speaker cables to the box and then back out to each amp. (this scares me a bit as who knows what damage can be done if both amps get turned on accidently and/ or speaker A & B buttons get pushed in at the same time ).

2.) Get an interconnect Y adaptor connecting the pre out to each amp.

Will either of the above degrade the sound?

Anyone know a better way to do this?