OK here is my take based upon my experience. An Agon member sent me his Cary 306 SACD player to perform upgrades. TO put this in perspective, my company manufacturers our own audio components. We also have been repairing, upgrading, modifying audio components for over 20 + years.
So we get a Cary 306 SACD in for upgrades. In stock form, it is rally nothing special. So we replace the laser, upgraded the Opamps, and replace 100 parts in the power supply section. Then nothing but awesome sound. We were completely in awe of the transformation. We are tube guys but we were so impressed that we may built a SS DAC based upon the results. Now understand that we have heard almost every transport and DAC available. So we are very experienced with everything mentioned above. One note, using my Metronome CDP as a transport into the Cary's DAC, was also an improvement.
So to answer your question, yes, upgrade your CDP.
Happy Listening.