There are abundant excellent recordings, but the vinyl restriction winnows it down. It would also rule out some of the contenders on digital. Leonard Bernstein first recording would be a no go for me on vinyl because the Columbia mixes were awful. Their CEO wanted the Bernstein Mahler recordings mixed as though the preferred playback system would be AM radio. Remixed for CD it’s wonderful. Claudio Abbado and the Chicago SO was problematic in that the offstage band was inaudible in many of the systems of the day (Google contemporary reviews). On CD it’s perfect, an excellent spatial effect, surely what Mahler intended.
Vinyl for me is a secondary medium, so I don’t own a Mahler2 on vinyl. The one that I played to death back in the day was Bruno Walter and the NYPhilharmonic (stereo-there are earlier mono recordings). Excellent classic record, but I have to add that the first time I heard it in CD I was blown away by the extra information on offer. The Solti recommendation above is probably a safe vinyl recommendation in terms of performance and SQ. Rafael Kubelik and the Bavarian Radio SO and Bernard Haitink with the Amsterdam Concertgebouw should be safe, but as you are in love with the piece, you don’t want safe-you probably want something overwhelming. In your vinyl shoes I would go for Solti