To my understanding to reach the best performance running directly from the source to the headphone amplifier you should find one with balanced input and balanced bypass so you use fully balanced signal path among your components, but running as you've stated AT THE SAME TIME... isn't a problem.
Grace Design M902 that had been already mentioned is one of the best contenders. You might even want to use it as a preamp vs. the one you currently have.
Grace Design M902 that had been already mentioned is one of the best contenders. You might even want to use it as a preamp vs. the one you currently have.