Get another pair of smaller Harbeths and set up a very near field (speakers 2-3 ft in frt of your chair) listening arrangement for late night. With a bit of practice you will be able to set up and remove in a matter of minutes.
Unless you already listen extensively to headphones, the change from speakers to phones could be unsatisfactory.
Unless you already listen extensively to headphones, the change from speakers to phones could be unsatisfactory.