It can be a very good idea (if you like the direct sound). The most important thing to consider is the quality of the volume control on the CD player's variable out. A poor volume control will sound worse than a decent preamp. Do a search on CD player's with volume control, and you should find plenty of previous threads on the same topic.
