I'm in the same place you are, I have a Arcam Diva cd192 and it is great. But like you, I know better could be had.
I think the Arcam cd23 is a much beloved unit because I have read so many wonderful comments about that unit,makes me want one.
With that said, I have been smitten with Accuphase amps,pre and power, I have bought. They are wonderful and the best I have heard. This got me thinking "Gee their cd players are most likely great" and if you read the reviews of their cd players, you should get the picture that there super,in one review the reviewer compare the sound to the 23.
Anyway, Im going there for my next upgrade from the Arcam,and Arcams cds are indeed good.
Best hunting!