Looking to build a system for under $5k

Good advice to audition some Vandersteens or other speakers first. Then choose an amp that is a good match for your speakers; proper power rating, features, and tonal characteristics that are right for your taste.
An integrated amp would be the way to go to fit your budget. Some integrateds have a phonostage built-in for a TT/cartridge, or you can use a dedicated phono preamp.

You may want to prepare for the future, (which is music streaming), by looking at an Oppo spinner which plays CD’s and can accept streaming services.

@audionoobie,
I believe you are getting many recommendations for an integrated amp as opposed to separates because you have stated that you are new to audio and have a $5K budget. A high-end integrated provides good "bang for the buck" and allows a generous amount of your budget to be devoted to speakers and a digital source.

If you can find a used preamp and amp within your budget, then go for it. I prefer separates, but you'll need advice when matching the components. Due to different designs in electronics, certain criteria must be followed when mating a preamp, amp and speakers, such as voltage gain, impedance, current. Not to mention, sometimes a preamp doesn't mate well sonically with a particular amp.
Even the most experienced audiophiles experiment with matching components to find the right synergy.

There have been recommendations to add a subwoofer without knowing what speakers you will have and the size of your room.
The Vandersteen 1Ci are a starting point and you may need a subwoofer, but first you'll need to audition as many speakers as you can. And also make a decision on floorstanders or monitors.

BTW, what are the dimensions of your room?