Just eyeballing my Phantom, I would think it should be OK if the armrest isn't straight forward. The antiskate is one of those string-and-weight assemblies, and it is actually supported by the armrest support.
I had to position my arm slightly wider (angled the other way from yours) to achieve adequate clearance from my VPI ring clamp. I have observed no adverse effects from having the armrest at an angle.
I had to position my arm slightly wider (angled the other way from yours) to achieve adequate clearance from my VPI ring clamp. I have observed no adverse effects from having the armrest at an angle.