Different Manufactures recommend differently. VMPS actually recommends removing the grills for critical listening. I don't know about you, but to me, all listening is critical. I have no children so I usually always leave the grills off. Besides, It's more enjoyable to look at the speakers.