From another thread on wbf and why your points resonate with me:
My views on audio reviewers
1. The goal of audio reproduction is to reproduce the original event heard by you at a particular place and time.
2.No reproduction methods today can do this because they can not reproduce the entirety of the soundfield at your ears as you experienced at the original event.
3.Therefore, with current technology we work with an extremely limited resolution facsimile of the original event.
4.The reproduced event as heard by some one else is not what you heard as no two people have the same hearing and ear/brain interface and emotional and physical make up.
5.Even if the recording is played over the same exact reproduction system including listening with the same speaker and or earphones or with your head in the same position, no other person can decide that a system is a better reproduction system without referencing it to another flawed (see 2, 3 and 4 above) system.
6.Any audio reviewers comments about a single component changed out in a system or an entire system reviewed with regards to what is best or most realistic simply applies to their opinion, and like taste in wine or any other human preference system, only reveals the preferences of the individual at that moment in time.
7.There are no rigorous, or otherwise, tests and certifications that prove that audio reviewers have any expertise in determining what is or is not a “better” component or system in regards to “better” resolution to the original event, and in fact they rate lower than audio retailers in the most simple tests given to date.
8.The technical obstacles related to the playback system as shown in 1 above and the extreme differences in the rooms and gear alone re-enforce my opinion that audio reviews are pretty much just so much entertainment value with little real world application.
9.Audio reviewers tend to say the same things over and over for all the gear they "review" and one only needs to look back over their years of reviews to find that out. Can each year really have a new and better gear in each category, based on memory or comparison of a component change out in an existing system....really...please.
10. Added Aug 2 of 2015. I wanted to add this as I failed to mention it. Audio reviewers claim to trust their ears, after all, that's what they imply you need to do. They almost all claim that it takes long term listening to hear the details and nuances that exist between components etc. They usually proclaim that short term listening does not allow you to tune into these nuances. However, the question I ask is, so after a week, or a month or whatever of listening, and now they "decide" or "hear" what is really going on, what led them to now believe their ears at that point in time? What biological element all the sudden "showed them the light" and why would they believe this as it seems to not occur at any regular time frame, just all the sudden like? If it is a gradual thing then what are their ears doing all along this time...are they adapting to the sound, or are they angrily just getting less and less tolerant of it, and how are they doing that?
Tom,
As you expect, I find some ambiguities and some disagreement ...
1. and 2. In 1 you refer to original event heard by you and in 2 you refer to sound-field or the event, two different thinks.
3. Assuming facsimile of 2, exact facsimile is not needed neither desirable. We need some aspects reproduced as close as possible to the original, others must be manipulated to overcome we are not assisting to a real event. It is the work of the recording and mastering engineers.
4. yes, it is why statistical analysis is needed to refer to a general preference and we must know the preferences of the reviewer.
5. No, our reference is not another system - it is created by our experience of sounds in real life.
6. IMHO a false and often repeated analogy. Preference of audio systems is not comparable to wine or other human preferences,,
7. Ambiguous reference to tests carried in conditions that do not allow for extrapolation the general audiophile needs.
8. Only if the review is poorly carried and written, we do not know how to read reviews or do not want to extract any think of use on it. One of the good things of a good review is that it can save our precious time - it will point us what to listen, making us a better and more efficient listener.
9. IMHO equipment is improving significantly - reviewers must refer what they feel. If you consider that differences are minimal between equipment generations - I know you are not alone in this aspect - I can see your point.
10. I have kept my ESL 63 - Quad 66-606 system - van den Hul cables - for the last 20 years and from time to time I assemble it and listen to it. Room, my hearing and musical preferences changed during this time, but the basic sound qualities are still the same.