It depends on the material being used, especially for the driver cone surround. Foam is (albeit musical sounding) very susceptible to rot, while rubber is more durable. I think the Xover components are not subject to degradation, because of the relatively low voltage of the signals and the low ambient temperature.
Chris
Chris