gain switch and volume control position

I have a Schiit Jotunheim headphone amp and a pair of Audeze LCD-2 headphones.  If I use the low gain setting on the amp, the volume knob is at about 1 o'clock much of the time.  If I use the high gain setting, the volume control is at about 11 o'clock.  Hard to tell much of a difference in sound quality.  

Is there any insight or advice on these two setting options?