No, that's right. Normal line level is around 1 to 3 volts. Your TV fixed is only half a volt (.47 to be exact) so of course you have to use variable and turn it up to get up over a volt where your receiver is expecting.
The position of the volume knob (or button, display, whatever) is one of the least relevant things in all of audio. Turn it up to whatever sounds best and forget about it.
The position of the volume knob (or button, display, whatever) is one of the least relevant things in all of audio. Turn it up to whatever sounds best and forget about it.