You can easily test this by leaving the speakers hooked up and plugging in the headphones. The speakers should cut out with the headphones plugged in. If that's the case there's no issue at all.
And if you aren't going to use your Harbeths anymore, send them to me. ;-)