I forget to include money for a decent cartridge, but can start (and possibly finish) with the highly regarded Denon DL-103R for ~$225 brand new.
Don't let that price fool you, it can keep pace with many of the $1k+ carts all day long.
More phono pres:
Dynavector P-75 - $600 new, $375 used
Pro-Ject Phono Box SE - $300 new
Pro-Ject Tube Box - $550 new, $300 used
Anyway, a VPI Scout, JMW-9 tonearm, the Denon 103R, and the Gram Slee Era or EAR 834P will give you a terrific, no hassle, sound. You'll need one of the Denon AU-3000(?) stepup transformers to boost the 103R's output up For the Gram Slee, but not the EAR 834P.