You need to throw some gain away, obvious is to dump the preamp/s. And use a 10kohm passive pre so anything can drive it. (save for some silly high output impedance sources) (usually tube).
Forget inline attenuators, too much of a gamble, you never know if you have an impedance match or not, (unless you know how to measure them) because from what I was told they don’t state what series/shunt resistances they have used inside them
Cheers George