Math Unraveled

Measurements are hard, and understanding them is harder. It is also very hard to construct a test that isolates what we are trying to measure, and the observer can corrupt the observation.

<snip>

That paper, or earlier versions of it, have been hotly debated for similar reasons.

I'm not sure what this post actually means. If we have all the measurements needed can anyone point to a known set of measurements that characterise how a device will sound? It seems to me to be too easy to say that we have all the measurements needed but yet can't point to how they correlate to what we hear (even if you think the exist stereo reproduction system is POS). Are we expected to operate on a belief system that all measurements are available & that it's just that no-one is actually doing them?

I believe what DonH50 posted above answers your question. I for one am not entirely certain we know what we entirely know what to measure.
 
We don't. Here's an example of one way we are still learning...

PMC%20testing.jpg


http://blog.acousticfrontiers.com/w...sure-loudspeaker-directivity-with-lasers.html

Tom
 
I believe what DonH50 posted above answers your question. I for one am not entirely certain we know what we entirely know what to measure.


Frantz: I can't find the pic (perhaps Amir can) that shows a graph with four speakers and that there was no difference in the order of choice among the trained/untrained listeners. I particularly remember it since it had ML at the bottom of the one speaker listening behind the blanket test and also that Kevin Voecks had shown me the same data two or three years ago at RMAF. It went against all our thinking at the time that trained listeners were made better choices than untrained listeners.
 
I believe what DonH50 posted above answers your question. I for one am not entirely certain we know what we entirely know what to measure.
Yes but Don's post isn't saying that we have all the measurements necessary just that using & understanding measurements is pretty difficult.
I'm not even arguing that we don't - I simply don't know. Therefore I am trying to find out from those who make statements like Tom to point out the measurements that can tell us how a device will sound to us. Until this is achieved, it's simply an unfounded statement that we have all the measurements needed.

Understanding more about the inner details of hearing (not just the mechanics) allows us to direct our measurements with more accuracy. So, for instance, this paper shows that linear systems (FFTs etc.) can be beaten by non-linear systems (hearing) in certain fundamental respects. A large number of instruments are non-linear device as is the human voice as is the playback systems we use & our hearing. Indeed non-linearity is the norm in reality. Does this not lead to the conclusion that Sine wave input signals being used to measure our playback systems is pretty misguided & is only used because it is easy to do & good for marketing purposes?

Yet, how often have we heard the quip in forums that a device "FFT shows no distortion below XXXdB & therefore transparent"?
 
John

We find ourselves in agreement. We will not learn much if we are trying to convince ourselves that we know it all and that not much needs to be learned. At the same time a certain degree of skepticism must be exercised so that we don't find ourselves running after an infinite number of targets.
 
John

We find ourselves in agreement. We will not learn much if we are trying to convince ourselves that we know it all and that not much needs to be learned. At the same time a certain degree of skepticism must be exercised so that we don't find ourselves running after an infinite number of targets.
Indeed, you are correct but there is no greater obstacle to learning/discovery than a closed mind. I find it easy to discard my wrong ideas - they are usually uncovered fairly quickly & there is as much to be learned from them as there is from the correct ideas - probably more!
 
John

We find ourselves in agreement. We will not learn much if we are trying to convince ourselves that we know it all and that not much needs to be learned. At the same time a certain degree of skepticism must be exercised so that we don't find ourselves running after an infinite number of targets.

+1,000

REAL and PRACTICAL objectivity
 
While I dont agree technically all the time with Ethan, he did atleast bring some open mindedness to the forum, but perhaps some folks dont want to open their mind the other way that I describe above.

While you're chuckling at your unanimity, I'm having a ball at your irony. Ethan bringing in open mindedness - bwahahahahahah :D
 
:D

If I post a number there likely be as many interpretations of causality as there will be people who see it.

Gives us an idea of how much more there needs to be learned and done.
 
and folks can hear a difference between two components and somehow want a measurment for it when they cant even lock their head in a vise to eliminate a huge part of the variance of hearing....really. While I dont agree technically all the time with Ethan, he did atleast bring some open mindedness to the forum, but perhaps some folks dont want to open their mind the other way that I describe above. And I am unanimous in that. aha ah a ha
This is hilarious in so many ways - some of which have already been highlighted - open-mindedness from Ethan :)
"Locking one's head in a vice" quip is exactly the lazy thinking that typically pervades pseudo-science in audio. The fact that we are able to adjust for head movement in our hearing leads to the conclusion that we are not a head with two microphones at each side & a linear processor in the middle. It's exactly this sort of foolishness that exposes limited thinking.

So it's doubly ironic that you should talk about open-mindedness & then cite such an obvious example of the antithesis of open-mindedness, Ethan. But you then go on to cite the obvious to all "head-in-vice" ridiculousness as the reason for variance in hearing....really?????

Yes, humour & levity are great on forums but please indicate it when posting so we don't misconstrue your posts

BTW, unless measurements actually have some relevance to the function of the device, what is your point? I like my measurements to tell me something of value about a device/machine - if buying a car I might want measurements to show something about the experience I will have in driving it. I'm not interested in the fact that measurements can show the chemical make-up of the body paint - it's completely irrelevant to the goal I have for using the car.
 
Last edited:
Frantz: I can't find the pic (perhaps Amir can) that shows a graph with four speakers and that there was no difference in the order of choice among the trained/untrained listeners. I particularly remember it since it had ML at the bottom of the one speaker listening behind the blanket test and also that Kevin Voecks had shown me the same data two or three years ago at RMAF. It went against all our thinking at the time that trained listeners were made better choices than untrained listeners.

I recall that too. So I am as a sophisticated a listener as, say, Keith Johnson? I guess I am having a good morning.

EDIT: In all honesty, I think that "test" was meant to show that even untrained listeners can select the "best" speaker that the trained ones can; but it backfired a little bit...
 
Last edited:
I'm not sure what this post actually means. If we have all the measurements needed can anyone point to a known set of measurements that characterise how a device will sound? It seems to me to be too easy to say that we have all the measurements needed but yet can't point to how they correlate to what we hear (even if you think the exist stereo reproduction system is POS). Are we expected to operate on a belief system that all measurements are available & that it's just that no-one is actually doing them?

Yes, Tom has repeatedly stated that the only measurement we need is THD. Amazing how a measurement, how many years old, still holds water!
 
While I dont agree technically all the time with Ethan, he did atleast bring some open mindedness to the forum, but perhaps some folks dont want to open their mind the other way that I describe above. And I am unanimous in that. aha ah a ha

OK give us two examples of Ethan not boasting about his intellectual superiority and crapping on audiophiles? OK, just one.
 
Head in a vice quip. Really. So, like I said, many on this forum understand the variances of audio and how stereo works but some figure that not returning their head to the same listening position will not alter what one hears? I think there is some filtereing going on when you read what I said, which I said again, maybe more clearly now.
Yes, there are differences in what we hear when we move our listening position but to use this as a reason for dismissing reported differences seems somewhat over-reaching, don't you think? very Ethan-like, I would suggest. I don't believe I incorrectly filtered what you said - it seems rather dismissive of reports of differences. Maybe you feel like Ethan, that all this has been sorted out over 50 years ago & "all this boring stuff" is just a waste of time?

"All of us on this forum are aware of masking effects, effects of the room, effects of humidity, altitude, flether munson curves, hearing difference related to frequency and direction of frequency and all this boring stuff, and folks can hear a difference between two components and somehow want a measurment for it when they cant even lock their head in a vise to eliminate a huge part of the variance of hearing....really."


There are hundreds if not several hundred reference products out there, and either one of them has the magic undefined mesaurment figured out or none of them do or there are hundreds of measurments we dont know about or no one can admit that the human hearing system is fickle and fallable and is where the real "missing and unknown measurment" is at. Look inward for the magic, not outward.
Again, a bit confused by this but you seem to be saying that we don't hear differences - it's all in the head & this is what should be measured?

As I said, no, I dont agree with all Ethan says, but then again, he has made some effort for some simple audio exercises here on this site, and of the few who did them, they were in my recollection (to the best of my recollection...I like that term aha ah) folks who had no problem with measurments, while none of the folks who hear all kinds of differences stepped up to the plate. Thats just a fact which I understand need not correlate with perceptions.
Yes, simplistic tests will always give simplistic results. I believe that he has been told this on more than one occasion but I see you keep his torch burning so let me repeat that simplistic tests based on simplistic reasoning will get you no further than you already are. I know these simplicities appeal in much the same way as tabloid newspaper headlines appeal to many but don't pretend that they are a statement of truth about anything.
 
Moving a head causes hearing differnces. Thats what I said, whats the issue with that?
You miss the point that this doesn't account for all or even a small portion of differences heard between systems. Yet you disparage those who hear differences because they don't have a fixed position for their head when listening.

Why do I seem to be saying that, I never said that, but I did say the "magic" is in your head, not some unknown measurment of an electical signal. Are my communications skills that bad :eek:
Yes, I'm afraid your comms are not really saying anything concrete or else not getting across to me anyway. Please state something explicitly with some exactitude & without the wiggle room for plausible deniability at a later stage.

So, are your ears more sensitive to detecting changes in an electrical signal (via mic and electronics and speaker) than test equipment which can look at any node anywhere in a circuit? If you say yes, I for one would like to know what your credentials are in formal electronics training or even pschyacoustics. Thats my whole original point a while back in this thread, which I was sure was going to meet resistance, simply that measurments trump hearing abilities. And there is nothing we can't measure in an audio circuit. I do agree with Ethan that no one has come up with the missing measurment or the missing ten or hundred of them. But, audio is like a religion and so thats why many of us are waiting for the missing measurments that we dont know how to make. I dont know how we got as far as we did in technology when all along we are missing these magical things.
Which brings us nicely back to the paper in the o/p. Yes these participant's hearing is more sensitive than the audio FFT tests that are normally used for the measurements you refer to above so is this not one example of ears beating measurements?

As said already, simplistic measurements & thinking will give simplistic results. I & others already questioned the wisdom of using a 1KHz sinewave & FFT analysis of a playback system. It is as far removed from music as you can get & fails to stress the playback system & reveal it's dynamic distortions. Now using a non-dynamic test & measuring it with great precision in the frequency domain should make you realise it's limitations. Trying to compare the accuracy of such measurements to the ears ability in this is pretty immaterial to anything of importance. Hearing is not an FFT analyser - it produces a far more complex analysis of a dynamic signal in real-time - not a simple snapshot of a static signal. The ears are almost certainly sensing & paying more attention to other areas of the sound field which aren't revealed in simplistic FFTs

Note: The ears do not measure electrical signal, rather it's the illusion of the sound-field that is being sensed.
 
Last edited:
While many might agree in principle with the proposition that measurements are more sensitive than hearing, you (Tom) present no evidence (nor for that matter has anyone else, anywhere) correlating specific measurements with specific audio qualities. Richard Heyser made a start at that, and others like Floyd Toole and even John Atkinson keep taking and recording many different measurements of both transducers and electronics in the (presumed) hope that some correlations will emerge, but that hope is only rarely borne out.

Why harp on 2-channel stereo as the main culprit to accurate sound reproduction when we can't even get that right? How does adding more imperfect channels really get us closer to accurate sound reproduction?
 
So from the results that listeners preferences didn't vary whether listeners were trained or not you can state that Olive position is that training makes no diference on one hearing acuity when he , Olive and Amir stated many tmes that in order for people to discern certain nuances they must be trained

While I admire Mr Olive for his training program, I have a few questions; 1st, how is the training administered? Is it in a controlled environment or self administered? If self administered over the computers, there might be problems. Once I took a test on my laptop which indicated I can hear 20khz but in actuality, I was hearing the distortion of my headphones. Also, if listening to a symphony over the computers, I am hard pressed to differentiate between the violin and viola and viola and cello. 2nd, how long is the training? It took me a long time for the violin. viola and cello. Initially, my system was not transparent enough and the viola and cello sound as one. After it was transparent enough, I still need the cue that it was above the cello to tell. Only after some time that I can do it. Listen to single instruments is quite easy but in a symphony not so if the placement cue is not there. 3rd, is there an exam? Is it geared towards minimum or high passing grade? The book I quoted says 10,000 hours to gain expertise and it was found that the rank and file violinists practiced far less than the 1st violin and the 1st less than the soloist. So, in this case who is the expert? 4th, there is a preference rating. This could be a double sword. How can you accurately predict one's preference? The guy who can only hear 10khz, 14khz, 18khz and 20khz respectively is going have a very different way of listening to the treble response. So is the guy who likes loose, accurate or overly tight bass. This is matter of degree not an exact science. Shouldn't the tester be trained rigorously to have no preference but IMHO, this cannot be achieved as we human listens differently.

People like Tom and Ethan will use the inconclusiveness to conclude that there is no difference but the reverse is also true because we do not have a standard that can stand scrutiny. Coupled with the findings of the paper in this thread and Amir's wrt to being able to hear into the noise floor (does this means those who hear a blacker black is not imagining things after all :p,), all it tells us is that we are nowhere near to conclusively say we know all that is to know.
 
I can't believe the old circular argument about how we can measure anything and everything and all measurements are better than our ears is still alive and well. Having the ability to take measurements is great. Knowing what to measure and how to interpret the data are quite something else. Outside of some people on this forum who claim otherwise, lots of intelligent people in this hobby including designers don't feel that we know all of the parameters that we could measure that will correlate with the sound that our ears hear. So saying that we can measure anything without admitting that we aren't sure of what should be measured and how to correlate those measurements with our hearing is disingenuous at best. Not everything is as simple as some people believe and would like others to believe as well.
 
I can't believe the old circular argument about how we can measure anything and everything and all measurements are better than our ears is still alive and well. Having the ability to take measurements is great. Knowing what to measure and how to interpret the data are quite something else. Outside of some people on this forum who claim otherwise, lots of intelligent people in this hobby including designers don't feel that we know all of the parameters that we could measure that will correlate with the sound that our ears hear. So saying that we can measure anything without admitting that we aren't sure of what should be measured and how to correlate those measurements with our hearing is disingenuous at best. Not everything is as simple as some people believe and would like others to believe as well.
Totally agree - my example of being able to measure the chemical composition of the body paint on a Porche says it another way - so what! - it's a complete red herring - tells us nothing about driving a Porche.

It's like someone so in love with their instruments & what they are capable of that they forget what to use them for.
 
Totally agree - my example of being able to measure the chemical composition of the body paint on a Porche says it another way - so what! - it's a complete red herring - tells us nothing about driving a Porche.

It's like someone so in love with their instruments & what they are capable of that they forget what to use them for.

It's called reductionism and it comes with all its pitfalls.
 

About us

  • What’s Best Forum is THE forum for high end audio, product reviews, advice and sharing experiences on the best of everything else. This is THE place where audiophiles and audio companies discuss vintage, contemporary and new audio products, music servers, music streamers, computer audio, digital-to-analog converters, turntables, phono stages, cartridges, reel-to-reel tape machines, speakers, headphones and tube and solid-state amplification. Founded in 2010 What’s Best Forum invites intelligent and courteous people of all interests and backgrounds to describe and discuss the best of everything. From beginners to life-long hobbyists to industry professionals, we enjoy learning about new things and meeting new people, and participating in spirited debates.

Quick Navigation

User Menu