Welcome to the club. I'm sure you'll find it a slippery slope in many ways. Equipment tweaking, treasure seeking, and aural euphoria. But don't give up on digital. If anything, the format can help you find good and bad vinyl. I don't konw that you need to spend 10s of 1000s of dollars to improve your listening experience. I mean you can but if you're starting out you don't want to have buyer's remorse about a piece of equipment that can't make a bad recording sound good.
I've found that when I buy vinyl vs digital (CD or HRes Files) it's very much about the release date and the matter in which it was recorded. Learning how to tell the difference between an original/second pressing vs a decades later remastering.
I have original jazz pressing I got from my father that I have duplicates of on CD and they both have places in my music collection. And sometimes I find digital to be better than vinyl for newer releases. It's all part of the hobby that goes beyond casual listening. I know a guy that has remained committed to 8-track for decades because he loves the sound and even has a deck in his car.