Sound and music

Forgetting about the sound of our systems for a moment, there is a larger question of how sound by itself integrates into our appreciation and comprehension of music. Those notes written by composers have no really significant meaning unless physically heard. 
 How much of a part does the sensual  aspect of music play in its apprehension, and what part does the stringing of those notes together play? A musician can read a score and visualize ( or audio-ize) the meaning of the music but without the physical sound how much is missing?  
 This has significance in the debate over how one listens to a system: for the sound or for the music.