How clean should your glass be that you drink from? There is a spectrum from completely sterilized to dirty. Right? The advice people give is to go beyond the hazy line that may make you sick. Same here. When we build a bridge, we don't build to exact capacity but add a safety margin. That safety margin allows us to objectively declare that we can handle the load. Same here. Using analysis of the audibility of the system distortion, we can determine the fidelity line we need to exceed for this assurance. See this article I wrote on this point and #2 below:
http://www.madronadigital.com/Library/AudibilityofSmallDistortions.html
I am talking about audible range. Music is great in masking a lot of distortion. But since we can't control what is music, there can be situations where distortion becomes audible. Think of a music that is faintly recorded. Should I be subjected to distortion when I turn it up? If said music is at -30 db, we have a lot of our dynamic range of 16 bits.
We do have reason that it has some value. It may not have a ton of value but it has some.