Out of (by memory 7 designers of note) not one single designer preferred passive.
Yes- of course they would - it a simple matter of electrical science. It is the same reason to avoid passive crossovers in speakers.
As you correctly point out - elements (caps etc.) will all add their slight signature to the sound as well as affecting the transfer function between poor impedance matched passive components and this is orders of magnitude more of a problem with passive components.
Good active circuit designs can minimize these issues by several orders of magnitude.
There is no debating these facts.
What people prefer or like to buy is entirely different. However from a perspective that seeks accurate audio reproduction there is no question that active amps are better.