Starting a Classical Vinyl Music Collection

I'm kind of in the same boat, although I just started with some Mahler, not for any particular reason other than I had liked what I'd heard at some point. I also have quite a few modern (avant garde?) composers that I've never really listened to so I just put them all through the VPI cleaner - it is indeed loud, but it does a pretty fantastic job. I just use earplugs when I am in cleaning mode. Looking forward to some headphone listening tonight.

Where to start?  Apply the same as CDs.

Classical music?  Gosh.  Sooo much to choose.  Genre.  Composers, Orchestras, Conductors, solo artist, style,,,,,, Movies!  Honestly, I don't like ALL of Bach, Mozart, Beethoven... scores.  I have favorites amongst them. Older record labels.   EMI. Dusch Gramaphone.  Older Living Stereo.  RCA  ??? red label?

Search Classical Music Classics on the web.  Get familiar with some names.

Stream or Youtube  those selections to see if they are to your liking.

Listen to classicals on National Public Radio. 

Search record labels like Mobile Fidelity, Sheffield, Telarc..  They probably cherry pick their selection due to their investment into remastering, recoding techniques...

Look for Compilations.  One disk with different composers or selections.  Best Of _______.

Where? Thrift stores. garage sales, auctions.  Here, Agon!!!  Visually inspect them if you can.

Sit while doing auction searches.  Lessen the chance of injuring yourself when you fall by the prices.

Just another opinion but here are a few absolutely must haves, as long as they are quality recordings on quality pressings.  Keep in mind that there are many different interpretations of these and most classical pieces.  Hunt around and find the performances you like best.

Beethoven's 9th and 5th

Korsakov's Scheherazade

Pachelbel's Canon in D (lots of many versions & interpretations of this one but London Symphony Orchestra is a good one)

Debussy's La Mer

Mozart (anything by Mozart)

Rossini's Overture to William Tell

Tchaikovsky's 1812 Overture

Wagner's Ride of the Valkyries

Enjoy!

OP

Do you know anything about Classical Music?  Your OP specifically mentions vinyl.

To me this implies that you know something about Classical Music, that this knowledge was acquired by other means (digital, radio, or performing it), and that you are wondering what is available specifically on vinyl.

  However, I suspect that what you meant to say was: 1) I only listen to vinyl 2) I know nothing about Classical Music, and what should I try?

  I suggest spending some time listening to a Classical Music Radio station to see what strikes your fancy.  Then perhaps stream a few different versions of the music you like, after identifying which recordings are available on vinyl.

  I could sit here all day and make specific composer recommendations, but it is a wide genre, and I am clueless as to what might light your fire

I see lots and lots of classical records for sale all the time for really low prices so it should be easy to do.