The only time I had that issue was when I was using the internal streamer and Audivarna software. I didn't have that issue when streaming with a Node or Innuos streamer, but they were connected by USB.
I've used the coaxial input with my cd player with no issues.