Dumb question?

Apologies in advance, I think I know the answer to this but I feel like I have to ask anyway because I just bought my first nice amplifier and I don’t wanna mess it up.

Is it ok to run an analog signal via RCA into an amplifier while it is off? I have a CD player with coaxial and rca outputs, and I plan on running the coaxial cable to my headphone amplifier for late night listening, and via rca to my integrated amplifier to power my speakers. There is no option to select an output for the CD player, it just sends it to both, so I will often times be sending the audio via rca to my amp while it is off. No big deal right? Or is this going to cause problems somehow over time?