I've got recordings that make my system sound horrible, and I've got recordings that make my system sound absolutely wonderful.
I'm thinking that you have it backwards. You have records that sound horrible or wonderful and your system sounds the same with either.