IME, it's true both that speaker sensitivity matters, and that manufacturers sometimes (frequently?) misleadingly exaggerate it. If you can't try a prospective speaker with your amp, at least gather as much testimony as you can as to whether amps similar to yours can drive it.
As for the other sense of sensitivity, I quite like my speakers, and only say nice things about them. This approach has "dramatic" positive effect on their performance!