As has been well said Audiophile is a completely appropriate term.
Perhaps sometime in the past you developed a misconception concerning audiophile types and you don't want to be classified according to that misconception.
There are many different personality types in this hobby, but don't worry. Just enjoy your pursuit and be yourself.
I Don't Want to be an Audiophile, What am I...
I don't know why I don't like the term Audiophile. There is just something about it I don't like. Too Euro Trash maybe? Perhaps Hobbyist is a better description for me?