Another analogy: To be a great race car driver does not require one have the ability to build a race car.
I would say having a deep understanding of music is a more fitting requisite to be an audiophile. But why the "fitness" test? IMO, being a perceptive music listener is a more distinguished accomplishment than being an audiophile. The latter merely facilitates the former.