Just like 44.1/16 bit can literally blow you away when done right, 96/24 bit can do it one better, when done right. Having said that, a great Toslink cable in a very revealing system may be all you need, leaving you to wonder if all the talk about higher resolution formats are just a numbers war, looking for your wallet.
Everyone's milage will vary depending on your means of transportation.
All the best,
Nonoise