I leave them on, but then again, the grills on my Eggleston Works Andra II are very, very thin, and do not obstruct the sound. (And I much prefer the looks with them on.)
Most speakers do sound better with the grills off, but again, that depends on the type of speaker.
And we have a Bichon Frise, white of course.
And when I say "we", I mean my wife and daughter have one.
(And so why are we telling each other what type of dog we have?
They are not stinking cats, that use grills for scratching posts!)
;-)