Sounds like a bad volume encoder. Sometimes you can carefully clean the contacts. They use a grease in some encoders that gets crusty over time and causes your exact same problem. I have repaired several of these type of encoders.
It could also be a faulty optical encoder but your symptoms really suggest a bad encoder. The fact the remote works is a good indicator