As others have stated, running a solid state integrated sans the speakers will cause no damage. Most integrated amps with a headphone port automatically disable the speaker output when a headphone is plugged in. If your HL5's stop out putting when you plug in your headphones, you'll be fine without them. You will also be safe when swapping phones if you have more than one pair.
