Should I change my CD player ?

As a big fan of Wadia I would try the Wadia direct into your amp. also steve huntley offers a few mods for your Wadia.

Going from the wadia its hard to get something better, its all got to do with the flavor you are looking for. If you want less definition go to something softer ie. tube cd player, if you want more analytical and flat go to sony, but wadia is dead neutral and very dynamic digital output, its that type of a thing, basically with this level of equipment its tuning it to your taste, not really what is a better unit, because nothing is universally perfect and yes System Synergy is gonna play the biggest factor, so if the wadia is perfect matched with a Boulder amplifier, it may not be with the Ayre sound, maybe a spectral Cd player is better with the ayre, etc... do not take that literal, but just for reference, gotta find the right recipe for you, maybe you do not like Garlic, see what I'm Saying :).

The CD Player's change must come from within.

Sigmund

Come from within? Oh like a cheap cd changer, so when you don't like how it sounds just press a button and go to a better recording :) Just kidding

Have you considered dealing with room treatments as this is the most over looked component!