Great reading on this subject can be found in a variety of articles. some were seemingly dated, yet still applicable, such as Julian Dunn's papers, "Bit's is Bits" & "The jitter Game" published by Stereophile's John Atkinson, and with Bob Harley.
One note of interest to me and this topic was the measured indication of when jitter becomes a negative influence 'audibly', to the music... the article noted ".... 100 pico seconds and above".
I found too many to list here... so just Google for them and have a ball.