Yes, you can mistreat your ears, but age comes for us all.
I actually find that using noise blocking IEM's reduces how loudly I play music, by the way. Of course you always have the club kid in the subway playing music so loud everyone can hear it, but for everyone else, noise blocking is the way to go. :)