How long does it take a decent quality speaker to "wear out"?

Speaker enclosures can wear out as well. Veneers can loosen, hardwoods can warp. Proper, rugged woodworking should see them last decades, however. Foam surrounds deteriorate over time, though newer types (from the last two decades or so) last somewhat longer, depending on their specific implementation. Not only direct sunlight and certain atmospherics can be their enemy over time, but also prodigious excursion. The cone and surround material that has stood the test for the longest time are paper cone variants and cloth surrounds. Paper cones, even older ones, usually have been given a moisture-repellent treatment, certainly pro units that can see use in harsh, outdoor conditions, and cloth surrounds - be they treated or not - last close to forever in fairly stable environments. Indeed, pro drivers are typically built like tanks. Put them at use in domestic environments and they're cruising along without being thermally or mechanically challenged, while sitting in relatively stable indoor humidity and temperature conditions. Rubber surrounds, even modern varieties, can become inflexible and crack, while other (butyl) variants last decades without issues. Rubber surrounds can be treated to remain flexible. Compression drivers run like forever. Some ESL's are very durable, though newer Quad's have a history of depressing failure rate, also being quite sensitive to the environment where they're used. Overall, it would seem the best way to ensure longevity of the mechanical parts in speakers is frequent use over the years, while generally avoiding driving them to their limits. 

The life expectancy of electrostatic panels depend on the specific models and operating conditions.  The Martin Logan panels do not arc and they do not develop holes in the diaphragm from arcing.  In that respect the panels are MUCH more durable than are the panels on Quad speakers.  However, the Martin Logan panels can be susceptible to to the wires that bring the charge to the panels corroding at the point where the wires attach to the panel.  I know someone who suffered from this problem because he stored his speakers in a garage that gets quite humid in the summer.  Owners in humid Southeast Asian countries also have reported similar problems with Martin Logan panels.  Otherwise, the Martin Logan panels seem to be quite long-lived.   

Had Royd Doublets for over 20 years, a friend has had them for 10, I would still love to get them back.

Think you are OK with the B&W for now+++ as they used good poly caps and wirewound resistors in their crossovers (you have already addressed the driver materials used).

How did you end up with good rectifier tubes for the Cary preamp?

DeKay

@dekay  , thanks for asking.  Well, I went on a used 5AR4 buying binge of sorts --a UK Amperex, a Holland Amperex, and a Hitachi/(Matsushita?); and I have a Gold Lion I bought prior to that and the original Sovtec, so if nothing else, (given my age) I hopefully have a life time supply.  

But of the three used tubes I bought I have only got around to running the UK Amperex, and I am liking the way everything is sounding for me right now.

But the thing is, I had the Gold Lion in before I put the UK Amperex in, and I thought it sound good with that and I never felt any sense of sonic revelation when I swapped it out.  And the same applies to the Sovtec that I swapped out.

I hate to say it, but maybe I don't have the ears for this.