Well yes high order harmonic distortion is in fact a thing to avoid for that reason but if someone really believes ear fatigue due to high order harmonics is truly an inherent problem still in in practice then just stick to tubes old or new and choose your distortions there because truly good modern SS amplification gear is better at that than ever before.
Its like saying fatty food is bad for your health. Yes it is so just find the foods that aren’t. Then make sure to avoid their downsides too. Bottom line is there is more good quality food that is good for your health available today than ever before. Why? Because people now care about that and science provides the means to make things better.