In general I would believe this is true. However, in some cases the speaker grill is actually part of the speakers sonic design. The Spica TC-50 and 60 are examples of this. The grill actually contributes to the damping characteristics of the speaker and should be left on. The tweeter has heavy damping on either side to combat side wall interactions.
