No, you don't have a taste problem or a hearing problem. In my experience, I was perfectly happy with every cd I listened to on my relatively inexpesive stereo setup. Then I upgraded. At first, I really didn't hear a difference and wondered if all this hifi stuff was a scam. But when I hooked up my older system a few months later, I really heard the difference. Same thing with going from poorly made cd's to better ones. The differences are not at first very apparent until you get used to a new standard. After a while, your ears will have done some passive learning and there is no turning back.
If you are happy with what you hear, and you do not yearn to hear something better, then be happy. You don't need to spend much money to enjoy music.