Hi Alan,
Thanks for honest response - I concur with everything you said and I like hifi+ fwiw (enjoy the writing).
To others,
In terms of the mythical test - is this the Harman how to become a better listener? I just googled and found this and it is free software to train the ear but I did not see a test per se.
It is one in the same. The tool is a bit like a video game where levels keep going up and difficulty increases with it. At every stage, a change is made to the frequency response and you are asked to identify which EQ band may have created. The difficulty level is proportional to the width ("Q") of the filter.
Harman does not use this test for testing speakers. This is a training tool to get people to recognize colorations and be able to identify them accurately and objectively so that product design decisions can be made.
The actual test is with music tracks and ABCD comparison between say, four different speakers. You listen to music on each one of them and give score of 1 to 10. I created a thread for the tracks the use here:
http://www.whatsbestforum.com/showt...-Music-Tracks-for-Speaker-and-Room-EQ-Testing (out of separate posts in this thread).
And this is the training software:
http://www.whatsbestforum.com/showt...e-in-How-to-Critically-Evaluate-Sound-Quality
I found that until I took the training and follow on blind test, I lacked the vocabulary to quantify in my mind what was good or bad about the sound I was hearing. Can you tell with certainty if one voice is boomier than others? You might think you can when you hear sample 1 and 2 by when 3 and 4 play, you all of a sudden realize how weak your ability was to identify the correct sound in that regard.
In my musical training we undertook quite a few tests where you listen to various instruments solo and together, follow the score, and circle notes that are deliberately sharp or flat. I think this would be a very interesting test to run amongst the "expert" audio fraternity. It is essentially not far off frequency testing other than being more linked to music rather than science.
Your method there is to catch mistakes that happen when people don't play music right. The mistakes that happen with loudspeakers and rooms are not that. The notes are perfect in each instant since all loudspeakers and rooms can be fed the identical sound.
What then goes wrong is that the room and speaker subject the frequency response of what they are told to play to variations that are as large as 30 db SPL! One would be horrified if told to stick an EQ in their system, close their eyes, randomly dial frequencies up down by factors of 10 to 1, and call it good. Yet that is precisely the performance a speaker presents in a room. I am not a musician but I don't think the test you are describing are designed to catch these errors.
We talk about colorations of electronics, analog vs digital, cables, etc. But none, none have been shown to have remotely this type of change to the frequency response that loudspeaker and room present. It is remarkable then that we walk out of a room, make a subjective remark about its sound, but not look at this variation by far dwarfing anything else in the room.
Superb sounding rooms and loudspeakers will be lucky to have 5 to 6 dB variation. The threshold of hearing can be as low as 0.5 db (for low Q resonances at frequencies around 250 Hz). And here I am saying if we get to 5 to 6 dB we are doing great, and that typical rooms and loudspeaker have response variations that are hugely more than this.
This is what the science tells us. We can throw that out of the window of course and talk about how this and that room sounded this way or that way. But unless you train yourself to know the difference, and can do so objectively without the bias of what the speaker looks like, who made it, and whether it is or isn't a speaker you own, you don't really have a solid foundation for your opinion to be correct. That we get upset due to someone saying it one way or the other, indicates to me that we have gone way, way too far in believing our own imagination here. One's opinion, if not based on some methodology, carries very little weight.