I have never rotated drivers, but, it is probably a good idea to do it. I know that Lowther driver owners do this regularly because the gap for the voice coil on Lowther drivers is extremely narrow and the slightest sag will result in scraping.
Drivers and how to clean them: Notes from ScanSpeak
Please use good judgement but if you ever wondered what the actual manufacturers recommend for cleaning your speaker drivers here's one maker's view:
https://www.scan-speak.dk/technical/tech-notes/
https://www.scan-speak.dk/technical/tech-notes/