Off, not up or down, but off. In this instance, go commando.
Dust covers are for keeping dust away, not to be on the turntable while playing a record. It's like putting a giant unwanted resonating badly tuned (complex resonances) tuning fork on the side of a vibrational measurement device - called a turntable. Generally considered to be a bad idea.