What does the term "Speed" mean in a speaker?

Speed refers to transient response. 

The ability to follow musical transients (percussion, strings plucking, etc) closely. Both the attack and decay are important. 

Speakers with lighter, stiffer cone materials, and strong magnet structures are usually  have good speed.

Ribbon, electrostatic, and planar magnetic drivers tend to have good speed.