Problem with Turntable leveling?

I leveled my turntable before I started using it, but:

when I lift the tone arm by means of the lever the arm tends to swing out towards the edge of the record a bit. If it were truly level, would it not go nearly straight up (and down)?