also realize that noise may be in the CD recording itself.
Do you hear any noise with the CD player stopped? If not then it is the recording. If so then that may just be the noise floor of your system. Do this test with the digital connection only and disconnet any other gear connected to...