I have been stopping by libraries on trips that I take around the country. Its hit and miss but generally pretty good hunting quality wise and they do not price by the piece so rare stuff is much cheaper than dealers. The other place I go is thrift shops. Quality is lower, but I generally find a really nice one for a dollar out of every hundred dogs.
Overlooked vinyl gold mines
Your local library! That's right. Many municipal libraries have annual or semi-annual book sales. Most material sold at these events come from donations by library patrons. My library always has an enormous amount of vinyl given to them by people cleaning out basements and attics. Just recently, I bought a box full of Soviet Union recorded and pressed LP's on the Melodya lable in EX+ to NM condition. All are Russian orchestras, performing Russian music. Some of the performances are great, some are average, but, the sonics are great. The price? .25/LP Keep your eyes on your local paper, ask the staff when the next sale is going to be. Better yet, ask them if they have taken in any records, get to know them, and when the sale starts, you will be ready. You get great deals, and your money goes to help support programs at your local library.