I think you could be right Tom,
BTW you just reminded about the Podcast John Atkinson did and it is a blinder-great one to listen to.
It is long but well worth taking time for members here, he also mentions potential of feedback amp design-cables-speaker, although in this scenario it is more about amp and speaker than cable from what I can remember.
Also it provides good background info on JA that I think many here never knew about (including myself).
http://www.ultimateavmag.com/content/podcast-17-john-atkinson
Anyway coming back to measuring what we hear and its challenges.
IMO this is really tricky because I am not aware of a single product combining software and both test generation-measurement tools that will allow for a time varying spectral envelope plot-analysis (showing all partials-harmonics against their FR and their amplitude over every ms) of say a musical chord and the attack-decay-sustain-release aspects of the sound/tone, including for this to be generated by the product into a DAC or preamp and then measured-compared to the real output inline (important and not isolating) beween any of these: DAC-pre-power amp-speaker.
For background on what I mean about spectral variations of time look at 2.10 in the useful PDF from Bill Buxton (appreciate quite a few here already understand this but for others its a really useful document).
http://www.billbuxton.com/AudioUI02acoustics.pdf
To do this and have accurate analysis and possible modelling-simulation of various musical instrument chords at different scale-FR may require something like Matlab combined with certain other measurement tools and probes.
However, even if this does show subtle changes in the spectral plot over time, this does not provide information to tell us why.
And IMO this is the reason such testing is probably not done by companies as they want a narrative to highlight the benefits-reasoning for purchasing a product.
So companies such as Nordost must go further in their analysis to not only show changes occur but how and why, and put this as a narrative to consumers to show why it makes sense to buy their product over others.
This is then made even more of a pig of an issue that if going for a narrative, they want to isolate the product from other factors in the real world such as other manufacturers preamps-power amps-speakers-source.
And this may be the downfall on ever trying to present more than slight measurement differences for reasons already suggested.
Good news though this is not what we really need here IMO, we just need to see if the various spectral plots (need to do different low mid and high musical notes) change and by what.
The details on why if there is a change can come later.
Cheers
Orb