Steve williams
Site Founder, Site Owner, Administrator
That guy lost an opportunity to discover some great music!!
how true especially coming from Keith who always finds new and eclectic music to bring to shows
That guy lost an opportunity to discover some great music!!
I heard this funny joke years ago:
"One third of Americans suffer from psychiatric illness. So look to your left and to your right. If those people look normal, it is you!"
There is no question that there are critical listeners and non-critical listeners. The problem is that while many of us think we are critical listeners, we have never had that hypothesis checked in an objective way. We may very well be the one who has it, but without some unbiased confirmation, we don't know. Yet we share and treat our opinions of audio equally, industry person or not.
Fortunately this issue has been tested, specifically by Dr. Sean Olive, ex-president of Audio Engineering Society, WBF member, and all around expert in testing acoustic opinions. Two of his studies come to mind:
1. Trained listeners vs not. This is probably the most depressing thing to read for most people here . That is, compared to people who are trained professionals, most of us don't even come close to what they can do in detecting coloration in speakers/rooms. Fortunately there is software that is free and available to become trained just as Harman people have taken: http://www.whatsbestforum.com/showt...e-in-How-to-Critically-Evaluate-Sound-Quality. In there you can see how we all do when we are not trained:
And this:
Too small to see but a group of these listeners were indeed audiophiles. We can see that trained listeners are far, far harsher on ills of bad sound. As a personal example, I can't listen to US DBS Radio (XM and Sirius) yet they have 25 million subscribers. To me the compression artifacts are unbearable even though I love the content and would subscribe otherwise.
I have sat through a large group of dealers at Harman taking the same test. As I have told the story before, with just a bit of training, I went from level 2 to 3 to level 6 or so using the software above. All the dealers failed to tell equalization changes to the music at level 2 and 3. Sean Olive though sailed past me and I believe their trained listeners can reach up to level 12 before they are qualified for the task. Download the software and take the test. It is easy, quick and humbling.
2. What we use to test matters and matters a ton. People are often surprised at the selection of music used at Harman for double blind acoustic testing. James Taylor anyone? That selection just in other fields, comes from huge amount of testing that detects what the most revealing content is, so that even untrained people have a shot at hearing the difference. Here is a great summary of Dr. Olive's AES paper on this: http://seanolive.blogspot.com/2010/03/method-for-training-listeners-and.html
And the most sensitive material for testing whether people could tell a +-3 db EQ at different frequencies:
Pink music followed female *pop* music! Look at the many reference clips we have that rank way, way low. Piano at #10 for example!
As a way of reference, human voice is very hard to compress and hence it is considered a "codec killer." As a result one of the test clips is Suzan Vega's solo voice. More revealing than a million classical tracks. Indeed classical music is not even used to test codecs because it is so easy to compress due to harmonic nature of it! Yet what is critical in codec testing, i.e. solo voices, is not in acoustic space with it ranking #15. I bet your first instinct for many of you is to use classical music to rate any system but that is not the most revealing material.
The danger here is that without using proper material and training oneself, the opinion becomes ad-hoc. So let's not put weight on one versus the other.
So whether it is Peter, or many outraged folks in this thread, the odds are against us, way against us, in having a valid/scientific opinion of what is bad sound. We have a preference and thank heavens, listening tests show that when it comes to acoustic domain, is similar to trained listeners. But most of us are not remotely critical listeners.
Also, I am an expert with years of experience with top level audio equipment... I am not a once-in-awhile casual observer.
So Amir, I wonder how those out there with that secret knowledge, i.e. the mainstream audio press, have done with the Harmon testing?
Thanks, Amir. That's a good reminder that listeners can be trained.
I would take this step one further - HOW the listener is trained will make the biggest difference to subjective preferences. If the listener is self-trained, then he/she will hear what he will have trained himself to hear. If the listener is trained to a program, he/she will have been trained to hear what the training program designer thinks is important.
That ingrains into the listening experience too - hence we have a huge spectrum of difference to our preferences. Take someone who listens to rock almost exclusively vs someone who listens to classical music exclusively (even live music). Their sonic preferences will be completely different. The rock loving audiophile who doesn't play in a band wouldn't know the sound of an unamplified, undistorted electric guitar even if a Fender Stratocaster was thrown at him. He is hearing a whole chain of electronics - and in a recording, hearing a whole chain of electronics recorded through another whole chain of electronics.
If you have lived with one sound that you have loved for years, you will already be predisposed towards that sound. Cognitive dissonance makes it difficult to switch out of something you are intimately familiar with. Hence, we can only take glowing reports and negative reports for what it is - a personal opinion. Reading too many glowing reports from one reviewer just makes me dismiss that particular reviewer. If a review does not reference back to the reviewer's own system, then I have no reference to his preferences and hence there is no foundation to build a review out of.
The playback equipment and the program material are also critical. This "test" published on NPR yesterday is interesting:
http://www.npr.org/sections/therecord/2015/06/02/411473508/how-well-can-you-hear-audio-quality
I got six out of six WRONG. Listening to my Toshiba Ultrabook "premium sound" speakers I picked out the 320kbps as "best" every time. On my computer, I can turn off the "premium sound" but then it sounds much worse but also much more "accurate" and I can find the WAV file easily. But, I wouldn't enjoy YouTube videos and streaming music as much, and I know that I am leaving a sound processing algorithm on my computer on. Many computer audio drivers are pre-loaded with these sound enhancements, and when I first published my "how to build a music server" white paper, the single biggest problem was audiophiles thinking that they don't have to follow ALL of the instructions and yet get the same results.
I once had a look at the laptop of a young, budding recording engineer who was mixing and recording his band. When he heard his CD on my system, he said that it sounded NOTHING like what he hears on his headphones when he mixes on his laptop. You know why? When I had a look at his set-up, yep, "enhanced stereo" was set on by default.
I think that many of us overly focus on the end result (what we hear at shows and demos) without knowing what the source really sounded like to the recording/mastering engineer or even the artist. Sitting at a piano, the sound is totally different to listening to it in the audience. Ask a violinist to listen to her own recording, and she wouldn't even recognize the sound. Even your own voice sounds different when you listen to a recording of yourself. We hear a 20 second snippet of a track and make a subjective judgement of an unfamiliar room and an unfamiliar system. Even if we bring our "reference cuts" to the show - we can only make a SUBJECTIVE judgement of how different the exhibitor's system sounds when compared to our home system.
At this point, 10 years into my career as a systems designer, I still don't know how to measure everything that I can hear. I KNOW that my reference cuts are only a reference to me, and will only refer to the last system I listened to. All I can do is to design gear and set up my rooms and systems up to as closely as possible reproduce a recording of a music event that I was at or a voice that I have heard live and unamplified. I think that I am supremely fortunate to have had honor of meeting artists like Anne Bisson and Lyn Stanley and having had the opportunity to hear their live, unamplified voices and also have a copy of their superbly recorded and mastered albums. I am lucky to know recording engineers like Jim Merod, and get copies of the recordings of jazz concerts that I was at. And to have been allowed to sit on the floor next to the bassist and stand next to the pianist (I haven't asked to sit on the bench with one yet) during the rehearsals and hear what their instruments sound like without sound enhancements and reinforcement.
At Newport, both Anne and Lyn performed. Did any systems upstairs sound like "live" using their CDs? Well, if any systems sounded "live", then those systems sounded like the cheap mic, the cheap mic cable and mic-amp, the soundboard, and the PA speakers being used to amplify Anne's and Lyn's voices. During Anne's performance, Jacques Riendeau had to tell the sound engineers there to turn the mic off on the piano, because it sounded really horrible.
We have to appreciate the hard work exhibitors have put in to lug all the gear to the shows, set-up to the best of their ability, and then pander to the audience. I think that if they had an open mind, they would also appreciate our comments - what we liked and what we did not like about the presentation. But we must also comment with an open mind that we are not the "expert" that we all think that we are.
My father told me that an expert is someone who knows more and more about less and less until he knows everything about nothing. If we kept our minds open and enjoyed the music for what it is - music - and make less definitive judgemental statements, we would all have a lot more fun.
*rant off*
how true especially coming from Keith who always finds new and eclectic music to bring to shows
thanks Doc- i aim to bring new stuff every year.
this year's version was Blake Mills "Heigh Ho" - just fantastic indie singer/songwriter music. recorded at Oceanway and the production work was quite special
This year Munich was really challenging- mostly because during the whole week, I only got about 7 hours of sleep Wah!
But we had really good sound. In fact, the best we have ever had at any show and the best I have ever heard at a show, period. But then I went online and saw all those negative comments people were making, although none of them included our room.... I really felt like they had not seen the whole show, and based on hearing some outstanding rooms at Munich, I began to wonder if they were even at the same show.
We had Lyn Stanley in our room, singing twice a day. When she was doing her gig, the room was so packed I could not even get inside. However it was that way a lot even when she was not around. We got a lot of really nice comments from people too. Some lingered for hours. So I can't help but feel that some of the negative comments I saw when I got back were people that had an even worse time with the travel than myself and so were just in a bad mood- attitude can make a difference. But Munich is utterly huge, and its hard to imagine seeing everything in only four days.
PS: I will also add to this thread, if you PM me regarding my OP, I will make it public. One coward has already done this and since I did not state this in advance, the cowardly PM will remain private. All future PMs will be made public.
As a way of reference, human voice is very hard to compress and hence it is considered a "codec killer." As a result one of the test clips is Suzan Vega's solo voice. More revealing than a million classical tracks. Indeed classical music is not even used to test codecs because it is so easy to compress due to harmonic nature of it! Yet what is critical in codec testing, i.e. solo voices, is not in acoustic space with it ranking #15. I bet your first instinct for many of you is to use classical music to rate any system but that is not the most revealing material.
This year in Munich, I attended at Hifi Deluxe the FM Acoustics demo. The double FM system delivered incredibly poor results beyond all expectations. Of course, there were bad circumstances but these bad conditions normally could have been addressed. I have hesitated before writing some words about this disappointing performance as we all know this equipment is able to sound very well. But I decided to express my thoughts and not to act as if this under-performance never existed...