I agree with what you've described re: stress/pain leading to inspiration.
I just played some REM from the 80s; Green, Fables of the Reconstruction, and Reckoning. I bought Monster, and Out of Time and then I left the building and stopped rushing out to get the next REM record. The edge they had in those earlier records, not just the 3 I mentioned, had gone by Out of Time. That's just my personal view; I know millions of people bought and thoroughly enjoy the later work. It's just not for me.
I suppose it's a similar story with U2: October, Boy, War, and then Unforgettable Fire was the pivotal record. We then had Joshua Tree which was "ok" but again, I stopped after this for the same reasons as with REM.
There are probably dozens of similar examples