Don't expect to find jazz bargains in NYC. Try Academy 12th Street (E. 12th at 4th Avenue), and the Jazz Record Center (W. 26th St., google the exact address). You might find some surprises at Mercer Books (Mercer Street between Bleecker and Houston), though the selection is much smaller than at the other two stores.
Patrick
Patrick