No worries, but some sources will sound louder than others will. I run the cable box, blue-ray player and xbox 360 into the TV using HDMI, from the TV to the DAC using a 20 foot glass toslink cable.
No noticeable delay at all.
No noticeable delay at all.