Agree with trytone on the Deccas--also EMI, which did a Vaughn Williams series that was excellent . The Robert Shaw Chorale did some recordings on RCA in the early stereo era, I have Deep River, a very good record of spirituals, as well as The Many Moods of Christmas, one of my favorite holiday albums. John Rutter's earliest records on Collegium were on vinyl (his Gloria and the Faure Requiem, as well as English folk songs and madrigals). And I think that Priory, which mainly recorded organs, also did a number of church choirs. You might also look for Gothic Records, which has a catalog and may still have vinyl in its inventory.
