How much is too much?

Then we will have to disagree, nothing new in audio forums :) because there are those with scientific backgrounds who themselves have experienced the difference between quick AB/X and long term listening preference.

Listening preferences are not usually quick ABX related switching, the only ABX or related switching I am aware of are those relating to Arny and co and specifically to prove whether there is audible differences, and as discussed this is-can be debated at length as seen in other thread.
Could you link scientific study highlighting no differences between long term preferences and quick ABX or quick switching.
I must admit I will be surprised if there is one because logistics involved for a long term-extensive controlled session would be an absolute nightmare, look at even the length of the study of one Harman preference study test that are not long term listening with specific training and listening traits, let alone how one would approach the training of the listener, but it would be interesting if one exists and I accept I have not seen every paper.
As you know I provided quite a lot of information in the ABX obsolete thread on various testing protocols and bias studies, so this is something I am very interested in.
If unsure, look to what JA has commented about his own experiences, but I appreciate this is anecdotal and for some not usable as they will not listen to JA's experience, even with his background being originally science degree educated and then research.
Thanks
Orb

Sorry, Orb, I misunderstood you, or you me...or both. No, I haven't seen any comparisons of quick-swithching and long-term preference tests. What I've seen is data indicating that subtle differences can be only be identified accurately and consistently through quick switching. I just assumed that being able to identify subtle differences accurately would naturally lead more better choce of preferences when subtle differences were involved, but perhaps not.

Tim
 
Sorry to keep this thread OT just a little bit longer, but it perhaps bears repeating something that I've mentioned several times already, and that I feel is key to achieving top notch sound. The sort of quality of playback that enables long term, fatigue free and a sense of "realness" listening will never be detected by quick switching tests, simply because the factors that come into play to either make the sound "good" or "bad" never have a chance to stabilise using this approach. All my experimenting, etc, has shown this over and over again, it typically takes hours to see whether the system looked upon as a single entity is truly on song.

Of course, quick switching will eliminate or pinpoint major discrepancies between configurations, but, for example, the sort of factors that allow "bad" recordings to be played and enjoyed at high volume will never be shown to exist using this method ...

Frank
 
the sort of factors that allow "bad" recordings to be played and enjoyed at high volume will never be shown to exist using this method ...

You'll get no argument out of me on that point.

Tim
 
(...) And on the personal experience front, I've done long-term listening to a new component, come to really enjoy it and believe it was a great improvement over the one it was meant to replace, then gone back to blind AB after a couple of weeks of listening and heard those big improvement immediately collapse into tiny little differences to absolutely unable to differentiate. And so I am pretty skeptical of differences discovered in the long term that don't reveal themselves with rapidly switched A/B comparisons.

Tim

Tim,
My interpretation of your experience would be that the methodology intrinsic to the rapidly switched A/B tests obscures the differences of the systems in reproducing sound in normal listening conditions.
IMHO nothing form what you describe motivates your skepticism unless you have a bias towards it.
 
Tim,
My interpretation of your experience would be that the methodology intrinsic to the rapidly switched A/B tests obscures the differences of the systems in reproducing sound in normal listening conditions.
IMHO nothing form what you describe motivates your skepticism unless you have a bias towards it.

There wasn't much methodology involved, micro. I got a beautiful high-end headphone amp in on loan for a couple of weeks. I listened to it and thought I heard...well, a whole plethora of the wonderful things we hear. It wasn't subtle. I loved the thing and had every intention of buying one. Then I put the old headphone amp back in the system and it sounded an awful lot like the new one, so I set it up so a buddy could switch between them when I had my back turned. It was subtle, to say the least; I couldn't tell which was which consistently. I thought I could. I thought I heard all the things I'd been hearing for the last two weeks. The trouble was I heard it on both amps; I didn't hear it on both amps. We switched rapidly. We switched not so rapidly. It was gone. And from this you would conclude not that the problem was that at first I could see, but at the end I couldn't see? Goodness you have to work awfully hard to rationalize your way there, but OK...

Tim
 
Sorry to keep this thread OT just a little bit longer, but it perhaps bears repeating something that I've mentioned several times already, and that I feel is key to achieving top notch sound. The sort of quality of playback that enables long term, fatigue free and a sense of "realness" listening will never be detected by quick switching tests, simply because the factors that come into play to either make the sound "good" or "bad" never have a chance to stabilise using this approach. All my experimenting, etc, has shown this over and over again, it typically takes hours to see whether the system looked upon as a single entity is truly on song.

Of course, quick switching will eliminate or pinpoint major discrepancies between configurations, but, for example, the sort of factors that allow "bad" recordings to be played and enjoyed at high volume will never be shown to exist using this method ...

Frank

While I admire your tenacity Frankie, I just have to say that when it comes to "realness" there's a limit to what even a hypothetically perfect system can do. The recording.
 
Jack, try to keep up. The worst recording presents no challenge to the magic soldering iron.

Tim
 
But on a serious note, I only keep repeating myself on this over and over again because it would be a great shame if only a small number of people ever experience what is truly possible with audio reproduction. So I see my job as being to keep goading people to lift their expectations :D, so that they keep trying just that little bit more so that maybe, just maybe, it'll fall into place for them.

You need to remember that this is just as hard for me, the sound is definitely not as good as I say is possible to achieve, every time I push the big start button. For example, today didn't end on a good note, something's gone out of kilter, out comes the toolbox again ...

But the really important thing is, I know how good it can be, and that's all I need to know ...


Now ..... back to our normal programming!

Frank
 
Last edited:
But on a serious note, I only keep repeating myself on this over and over again because it would be a great shame if only a small number of people ever experience what is truly possible with audio reproduction. So I see my job as being to keep goading people to lift their expectations :D, so that they keep trying just that little bit more so that maybe, just maybe, it'll fall into place for them.

You need to remember that this is just as hard for me, the sound is definitely not as good as I say is possible to achieve, every time I push the big start button. For example, today didn't end on a good note, something's gone out of kilter, out comes the toolbox again ...

But the really important thing is, I know how good it can be, and that's all I need to know ...


Now ..... back to our normal programming!

Frank

So Frank, will you charge $140k for your system when it's complete?
Sounds like it's truly breakthrough to me :)
 
Sorry, Orb, I misunderstood you, or you me...or both. No, I haven't seen any comparisons of quick-swithching and long-term preference tests. What I've seen is data indicating that subtle differences can be only be identified accurately and consistently through quick switching. I just assumed that being able to identify subtle differences accurately would naturally lead more better choce of preferences when subtle differences were involved, but perhaps not.

Tim
Quite possibly Tim :)
But more likely we have different perspectives of what listening for differences and preference are.
Quick switching is definitely useful for identifying differences, but the key criteria in this situation is the listener being trained to understand and then listen for the parameter-trait.
Even then this just provides a way to analyse subjectively and quantify what is heard, however it does not necessarily equate to one's own preference; as an example what we think we want does not mean it matches our long term preference.
This is also compounded by what we think is better quality; a better approach is not to consider one better than the other but to analyse and quantify the differences against a true reference.
If looking to buy a product then considering preferences also has to look at one's self perception-satisfaction-cognitive behaviour, and not just to identify what one thinks has better bass-imaging-tonality-more realistic-etc.
In this way we are more sensitive to aspects that are a type of cognitive dissonance to us as an individual, and are as important as the initial enjoyment when considering long term listening.
That aside, also it is worth considering the approach for preference tests, such as done at Harman involve multiple products with trained listeners with rating set parameters and not the ABX switching scenario (which is usually used as mentioned in the other thread to prove if two products sound different debate, most scientific JND studies use other methodologies).

Now coming onto the context of subtle differences being picked up on cognitive behaviour but not consistently or with high confidence with quick switching.
What we are talking about here are very subtle differences that may fail ABX type comparison for reasons I mentioned in the ABX Obsolete thread (bearing in mind I still stress this is unknown although as I pointed out other just noticable difference tests are used in science studies) relating to confusion due to multiple reference points/anchoring/etc, along with bias that is applicable to all such perception tests including ABX.
Along with the above, we also have the challenge of training one to actively hear and be able to identify the parameter; example such as distortion/artifacts/etc.
So it is quite plausible for a factor not to be identified but also still affect us, and this is then compounded by tolerance and threshold with duration.
A very simple example is to consider listener fatigue where the person may not be able to identify the factor involved and indeed the product is rated good, but longer listening sessions then cause the listenes tolerance to reach its threshold and trigger a form of cognitive dissonance.
Another example would be % distortion, where the listener really needs to be trained to identify the % value, but it is fair to say even untrained listeners can and will have long term tolerance problems at certain thresholds.
This is part of the reason (or one anyway) why some audiophiles change parts of their system frequently, especially when they have the itch-dissatisfaction-feel it can be better.

Now I appreciate you may not have that itch-dissonance, which comes back to the original context with regards to the conclusion for you that different DACs make no difference in your system.
The suggestion here is that if two DACs still seem inaudibly different and yet are using two very different filter-noise shaping then it may make sense to investigate why.
Of course the DACs you have tested all may be using the internal DAC chip and also the integrated filter-noise shaping function, so they are all still near enough the same.
But if they are different filters and the DACs seem audibly identical, a longer term listening session may be required if they are using different filters to be aware of cognitive behaviour or possibly becoming aware of certain factors one were not initially (such as maybe one having higher uncorrelated jitter subjectively affecting clarity).

As we are going way off topic, might be worth focusing discussion then on the DACs tried and their filters, if you feel it is worth carrying on this side of the discussion.
But in summary it is unfortunate that really all we have relating to long term preference-cognitive dissonance in this example-JND audible differences and limitations-etc are all either speculation or anecdotal experiences when taken in context of audio perception and preference.
Hope this helps to clarify.
Cheers
Orb
 
Tim, Frank, you guys slay me! Hahahahahahahaha!!!!!!

I deserved that by the way!
 
So Frank, will you charge $140k for your system when it's complete?
Sounds like it's truly breakthrough to me :)
Well ... I'm sorta liking this 7% rule mentioned earlier, so I'll have to buy 'nuff of those boutique components costing multiples of $100s to push up the component cost to around $10k: with a bit of a push I should get there ...

Trouble is, I'm too much of an engineer to buy anything more fancy than what's needed to do the job; with regard to the 2.4kW amp I'll hopefully be able to do the raw component materials list for $1-2k, so that gives an idea there.

As I have said before, to get the good sound I talk of, everything, absolutely everything in the setup has to be right and that's the really hard bit. There's another way of getting there, and that's by getting under the hood yourself, or having someone else do it, on your current gear, working at everything that's dragging the quality down right now ...

Frank
 
Last edited:
I really don't see much trickle down "technology" any more, so I will disagree. I see a lot of tiny shops trying to soak the uber-rich as a business model. Even shops like VAC have gravitated in that direction---Kevin Hayes doesn't make a box under 10k now. I wonder why. His top of the line monoblocks are now 78k/pair. This is 50% higher that ARC or VTL. Ken Shindo's top amps are 30k a pair which seems like a bargain in comparison- and he's a small producer with the historically strong Yen at his back. How on earth are Spectral 360 IIs only 20k? Another small manufacturer with realistic pricing--so that's not the excuse.

I also feel that people comparing this industry to cars is a bit off as well. You can't tell me a pair of Constellation amps should cost as much as 911 Turbo. Sorry. There is 100x the engineering in a Turbo than an amp, it's really not funny. And no disrespect to CA---I'm sure it sounds great. Isn't the "trickle down" stereo CA amp like 60-75k?

I sold a guy my ARC LS25MKI who took it into a local shop to compare to more recent ARC preamps---it wasn't embarrassed. That preamp was built in 1999. I know several Ref 1 owners who refuse to "upgrade" despite the means to. A 911 is a vastly different machine than the 90s (although my fav Porsche period is a 993 from 1996--have a soft spot for air cooled engines)

One other issue is we can't audition any of this crap anymore, so the JVs of the world have discretion on what is SOTA. He has tremendous influence on this business, so it's not the "whatever the market will bear, stupid" that some comment on. There is no real market--as people buy only off reviews that make them feel they have to keep up with the Joneses. We don't shop for audio like automobiles.

Finally, the used market offers clues on how overpriced this stuff is. Pretty much none of it can hold 40% of it's MSRP.

KeithR
 
Yes well stated, except I can't swallow the part about JV's of the world directing the market. I don't see anybody here following them like sheep to the slaughter.
 
Quite possibly Tim :)
But more likely we have different perspectives of what listening for differences and preference are.
Quick switching is definitely useful for identifying differences, but the key criteria in this situation is the listener being trained to understand and then listen for the parameter-trait.
Even then this just provides a way to analyse subjectively and quantify what is heard, however it does not necessarily equate to one's own preference; as an example what we think we want does not mean it matches our long term preference.
This is also compounded by what we think is better quality; a better approach is not to consider one better than the other but to analyse and quantify the differences against a true reference.
If looking to buy a product then considering preferences also has to look at one's self perception-satisfaction-cognitive behaviour, and not just to identify what one thinks has better bass-imaging-tonality-more realistic-etc.
In this way we are more sensitive to aspects that are a type of cognitive dissonance to us as an individual, and are as important as the initial enjoyment when considering long term listening.
That aside, also it is worth considering the approach for preference tests, such as done at Harman involve multiple products with trained listeners with rating set parameters and not the ABX switching scenario (which is usually used as mentioned in the other thread to prove if two products sound different debate, most scientific JND studies use other methodologies).

Now coming onto the context of subtle differences being picked up on cognitive behaviour but not consistently or with high confidence with quick switching.
What we are talking about here are very subtle differences that may fail ABX type comparison for reasons I mentioned in the ABX Obsolete thread (bearing in mind I still stress this is unknown although as I pointed out other just noticable difference tests are used in science studies) relating to confusion due to multiple reference points/anchoring/etc, along with bias that is applicable to all such perception tests including ABX.
Along with the above, we also have the challenge of training one to actively hear and be able to identify the parameter; example such as distortion/artifacts/etc.
So it is quite plausible for a factor not to be identified but also still affect us, and this is then compounded by tolerance and threshold with duration.
A very simple example is to consider listener fatigue where the person may not be able to identify the factor involved and indeed the product is rated good, but longer listening sessions then cause the listenes tolerance to reach its threshold and trigger a form of cognitive dissonance.
Another example would be % distortion, where the listener really needs to be trained to identify the % value, but it is fair to say even untrained listeners can and will have long term tolerance problems at certain thresholds.
This is part of the reason (or one anyway) why some audiophiles change parts of their system frequently, especially when they have the itch-dissatisfaction-feel it can be better.

Now I appreciate you may not have that itch-dissonance, which comes back to the original context with regards to the conclusion for you that different DACs make no difference in your system.
The suggestion here is that if two DACs still seem inaudibly different and yet are using two very different filter-noise shaping then it may make sense to investigate why.
Of course the DACs you have tested all may be using the internal DAC chip and also the integrated filter-noise shaping function, so they are all still near enough the same.
But if they are different filters and the DACs seem audibly identical, a longer term listening session may be required if they are using different filters to be aware of cognitive behaviour or possibly becoming aware of certain factors one were not initially (such as maybe one having higher uncorrelated jitter subjectively affecting clarity).

As we are going way off topic, might be worth focusing discussion then on the DACs tried and their filters, if you feel it is worth carrying on this side of the discussion.
But in summary it is unfortunate that really all we have relating to long term preference-cognitive dissonance in this example-JND audible differences and limitations-etc are all either speculation or anecdotal experiences when taken in context of audio perception and preference.
Hope this helps to clarify.
Cheers
Orb

I think we may agree on this one, Orb. I think quick switching, blind, is the best way to uncover differences, or the lack thereof, between components. I think blind listening, but slower, longer, is the best way to choose your preferences between components. But I think long-term listening, in your own home, is the best way to discover what you like, and to be prepared to identify it in short listening sessions, whether that's sighted in a dealer's showroom, or unsighted in the kinds of preference tests Harman utilizes.

I know my preference for a fast/uncolored/analytical/lean...whatever you want to call it...sound actually developed over the course of several years and systems.

Tim
 
That qualifies alright.
 
How on earth are Spectral 360 IIs only 20k? Another small manufacturer with realistic pricing--so that's not the excuse.

This is all a matter of perspective, I suppose. I shudder at the juxtaposition of $20k and "realistic pricing" in a conversation about mono amps, but I sometimes forget that most high-end amp designers have to design the damn things without a clue what they're going to have to drive and the answer may very well be some huge monolith impractical in anything but the largest domestic spaces, with an impedance curve that looks like a rocky mountain ridge averaging at 2 ohms. Tough room to work, the high end. And really, the only way to do it well is to build a monster that will be monsterously over-engineered for most of what it might face, but up to the task of the worst-case scenario.

Tim
 

About us

  • What’s Best Forum is THE forum for high end audio, product reviews, advice and sharing experiences on the best of everything else. This is THE place where audiophiles and audio companies discuss vintage, contemporary and new audio products, music servers, music streamers, computer audio, digital-to-analog converters, turntables, phono stages, cartridges, reel-to-reel tape machines, speakers, headphones and tube and solid-state amplification. Founded in 2010 What’s Best Forum invites intelligent and courteous people of all interests and backgrounds to describe and discuss the best of everything. From beginners to life-long hobbyists to industry professionals, we enjoy learning about new things and meeting new people, and participating in spirited debates.

Quick Navigation

User Menu