Over the years I have owned some pretty "Good" equipment. The one thing that stands out the most was simply Knowledge. Learning about component synergy, cable choices, room treatments, set-up etc. This has had a profound effect on my enjoyment of my system and music. More so than any one product, although thy have slowly gotten progressively better/more expensive.
Your first component that was "special"
I got into hifi 40 years ago. I had a Pioneer receiver, Kenwood table, various entry level cartridges (ADC, Stanton, Empire) and Studio Design speakers. I wound up buying a Shure V15 Type 3 cartridge. That was the first piece of gear I bought that was way beyond ordinary. I had kept the cartridge until about 2o years ago- I sold it because by then no decent replacement stylus was available. Wish I still had it.