Is ABX finally Obsolete

Status
Not open for further replies.
So passing an ABX did nothing at all to end those allegations.

Of course not. Just as the Carver test, the famous Stereophile "Do All Amps Sound Alike" test, and subsequent tests/publications such as the Meyer and Moran study do nothing to end subjectivists' beliefs regarding the dramatic differences between amplifiers and resolution rates. Entrenched beliefs change hard, and usually only through personal experience. The funny thing about the examples just mentioned, is the Carver challenge was specifically about amplifiers not sounding alike and the Stereophile article "proved" that they do. What conclusions can we reach from that? Well, most Audiophiles concluded that the testing was invalid and dismissed the whole of it. Personally, I concluded that all amplifiers sound alike, except when they don't.

Tim
 
Just a quick thought: what testing has been done, using ABX techniques say, to try and determine how different the sensitivities of people's hearing in respect to musical characteristics are from each other, and to try and find if there are any trends in terms of people's experience, culture, racial background, age, sex, etc, etc. In other words, looking at the ABX thing from the other direction.

Yes, I'm sure I could Google up various material, but in the context of this thread what would be the most relevant studies done?

Frank
Most of those factors I have seen dealt in scientific studies rely upon some form of same-different/4iax,2afc,etc.
None have involved playing say a musical track, but as mentioned earlier melodies/tones/words/etc.
The consideration is the use of sensitivity and threshold in your post Frank, which have certain given methodologies-tasks that is more than ABX.

Are you asking in the context of ABX being used for comparing audio products and the debate that generates where it is put forward by a group that well designed amps sound the same, or more from identifying the use of ABX beyond that debate and practical uses such as done with validation of codecs-compression-etc ?

Cheers
Orb
 
Last edited:
Just a quick thought: what testing has been done, using ABX techniques say, to try and determine how different the sensitivities of people's hearing in respect to musical characteristics are from each other, and to try and find if there are any trends in terms of people's experience, culture, racial background, age, sex, etc, etc. In other words, looking at the ABX thing from the other direction.

Yes, I'm sure I could Google up various material, but in the context of this thread what would be the most relevant studies done?

Frank

I don't know of anything that addresses hearing sensitivities related specifically to music content, but there's plenty of documentation out there about hearing and age, occupation, etc. Sensitivity to loudness and frequency should translate directly to sensitivity to musical content. There's no reason to believe it would be any different. Now I've known plenty of people with very average, or even below average hearing with a remarkable ability to hear subtleties in musical content, but these were audio pros and it had to do with training, awareness...developed listening skills, as far as I could tell.

Tim
 
There's no reason to believe it would be any different. Now I've known plenty of people with very average, or even below average hearing with a remarkable ability to hear subtleties in musical content, but these were audio pros and it had to do with training, awareness...developed listening skills, as far as I could tell.

Tim
That would be the key point: whether research has been done that was very specifically directed in trying to assess in some numerical way, exactly what you have described: that a person's ability to discriminate in musical relevant areas of hearing were subject to factors beyond simple hearing ability, e.g., by training oneself through high focussed, intense exposure.

Frank
 
That would be the key point: whether research has been done that was very specifically directed in trying to assess in some numerical way, exactly what you have described: that a person's ability to discriminate in musical relevant areas of hearing were subject to factors beyond simple hearing ability, e.g., by training oneself through high focussed, intense exposure.

Frank

I guess that's where I cross over to the subjectivist/intuitive side, Frank. If a percussionist can differentiate between two cymbal sizes on a good recording, a guitarist can spot a jumbo vs. a 00, an engineer can get really close to guessing what a limiter was set at, or what kind of mic was used to record a vocal...I know why. I don't need to see the math.

Tim
 
You are correct. You don't get any "credibility" from taking one test-pass or fail. The point is that he is totally confident in his ability to make valid evaluations. He allowed himself to be baited into taking a blind test. "You will not take a blind test because you know you will fail and be exposed as a liar and a fraud. So passing an ABX did nothing at all to end those allegations.

can I confess I now have no idea where you are on the page? I am not even sure what I am correct on!

The point is that EVERY subjectivist is totally confident in their ability to make valid comparisons. That's why they 'don't need no stinkin blind test'.

Unless you are talking about a different situation (already mentioned I only know of one) HOW was he (MF) 'baited' into taking a blind test? The single one I know of was a group one, IIRC he got 5/5 and JA got 4/5, or so the reports go.

(is this where I was correct?) Yes, if there was a true desire to find out, they should have been taken aside for further testing. And yes, you can make statistics say anything you want. Was it 'fair' to lump their results into a collective? Well, on a global level perhaps, but again if a genuine curiosity were there they should have had extra testing (if they were up for it that is)
.
I think this is half the problem, it is so 'combative'. Never end the allegations??

You seem to be very selective in what you respond to BTW. I specifically asked 'why does him passing ONE test involving TWO ONLY amps somehow translate to meaning he, therefore, ipso facto and supra (;)) also MUST be able to hear the results of vinyl demag'? Yet, to you, it does. AND, by your own lights, it cannot be shown he even passed a DBT on the amps anyway, no matter how suggestive it is that something could be up.

I do agree however (if this is part of your thrust) that as a result of that 'treatment' (which was shabby, as was the pear cable debacle) he is not likely to be disposed in doing another.

A pity and a shame, we all lose from that. No one wins.

I did not address this bit before, and you (again) did not choose to respond to the question of linking to the cable test in this forum (nor the withdrawal of your DBT protagonist). Earlier I asked you, and stressed my interest in, your personal reactions to any blind test you had been in.

You had however done a blind test between two audiophile cables and found no difference. Can you tell me your thoughts on it please? Perhaps a little explanation if inclined on the methodology.

You seemd to think because they were 'audiophile cables' that I would have no interest. Not true. What I DO find interesting is that you found no difference. Do you too not find that interesting?

Because this is what I deduce from it. (correct me where wrong). For a couple of very strong reasons I think you must have heard a difference sighted no? For starters, it beggars belief that if you had NOT heard differences that you would, nonetheless, go on to do a blind test between them. I mean for what earthly reason would anyone do that, let alone someone who is strong in the idea that blind tests improperly result in 'no difference results'??

And further, why would a person who in particular feels blind tests (of any description) very hard to set up and do, be the one to set up and do a difficult blind test between cables he already feels has no difference??

So, that is my reasoning, hope it bears some resemblance to the truth.

So, again, can you tell me your personal reaction to a 'discovery' like that? Did it in anyway make you pause? Or did it simply confirm your thoughts that blind tests are useless (as proven by your own)?

(Orb, I think I kinda covered your points? I know I didn't quote you, but I was not ignoring you either)

(general comments, not directed at greg as such..better clear that up as he is the one I quoted)

All of the above..that any result is only applicable to that person in that situation with those components yada yada (did I cover it well enough?), and all this talk of statistics and interpretation etc, is why I say 'bugger that crap, just do a level matched simple blind test, swap between the two, and see how you go'.

It WILL only apply to you, but it is a damn sight better than armchair theorising and Ivory Tower speculation. It will be a personal experience and reality.

Seriously, it will at least challenge any notion you might have that you are influenced by sound only. The upshot is that in contrast to the (almost sure) rude shock you will experience, once past that it is (as it can only be) very liberating and empowering, whatever the outcome you get.
 
Of course not. Just as the Carver test, the famous Stereophile "Do All Amps Sound Alike" test, and subsequent tests/publications such as the Meyer and Moran study do nothing to end subjectivists' beliefs regarding the dramatic differences between amplifiers and resolution rates. Entrenched beliefs change hard, and usually only through personal experience. The funny thing about the examples just mentioned, is the Carver challenge was specifically about amplifiers not sounding alike and the Stereophile article "proved" that they do. What conclusions can we reach from that? Well, most Audiophiles concluded that the testing was invalid and dismissed the whole of it. Personally, I concluded that all amplifiers sound alike, except when they don't.

Tim

Tim,
I have expressed several times my disbelief in the Meyers and Moran study and will not loose any time on it, but you are misrepresenting the Carver Challenge, IMHO a milestone in audiophile testing, with your funny conclusion.

At the time, between other many things the Carver Challenge could prove that an unmodified cj Premier 4 had all the qualities that audiophiles highly praised "Depth presentation, midrange solidity and 3-dimensionality, imaging, high-end sweetness—in short, all the characteristics one normally finds important in amplifier evaluation" and a competent designed stock USD 700 amplifier did not have them. The challenge has shown that a genius designer such as Bob Carver could modify his amplifier to the point it could not be distinguished from the Premier 4 in some particular conditions - a fantastic achievement that shows that audio is not a stationary situation and for sure it was a lesson at the time.

Any one can read all the details in this narrative article in the Strereophile site.
http://www.stereophile.com/content/carver-challenge

But please do not use this Challenge to add noise to this tortuous thread. :(
 
Tim,
I have expressed several times my disbelief in the Meyers and Moran study and will not loose any time on it, but you are misrepresenting the Carver Challenge, IMHO a milestone in audiophile testing, with your funny conclusion.

At the time, between other many things the Carver Challenge could prove that an unmodified cj Premier 4 had all the qualities that audiophiles highly praised "Depth presentation, midrange solidity and 3-dimensionality, imaging, high-end sweetness—in short, all the characteristics one normally finds important in amplifier evaluation" and a competent designed stock USD 700 amplifier did not have them. The challenge has shown that a genius designer such as Bob Carver could modify his amplifier to the point it could not be distinguished from the Premier 4 in some particular conditions - a fantastic achievement that shows that audio is not a stationary situation and for sure it was a lesson at the time.

Any one can read all the details in this narrative article in the Strereophile site.
http://www.stereophile.com/content/carver-challenge

But please do not use this Challenge to add noise to this tortuous thread. :(

Sorry, micro, I didn't mean to raise the noise floor, but the Carver challenge is a wonderful example of amplifiers not sounding alike...until they do. Which was my point.

Tim
 
Terry
can I confess I now have no idea where you are on the page? I am not even sure what I am correct on!
Gregadd
Sorry. It seems clear to me.
Terry
The point is that EVERY subjectivist is totally confident in their ability to make valid comparisons. That's why they 'don't need no stinkin blind test'.
Gregadd
Yes we are. Based on decades of experience.
Terry
Unless you are talking about a different situation (already mentioned I only know of one) HOW was he (MF) 'baited' into taking a blind test? The single one I know of was a group one, IIRC he got 5/5 and JA got 4/5, or so the reports go.
Gregadd

You're kidding, right?
Terry
(is this where I was correct?) Yes, if there was a true desire to find out, they should have been taken aside for further testing. And yes, you can make statistics say anything you want. Was it 'fair' to lump their results into a collective? Well, on a global level perhaps, but again if a genuine curiosity were there they should have had extra testing (if they were up for it that is)
.
I think this is half the problem, it is so 'combative'. Never end the allegations??
Gregadd
No comment.
Terry
You seem to be very selective in what you respond to BTW. I specifically asked 'why does him passing ONE test involving TWO ONLY amps somehow translate to meaning he, therefore, ipso facto and supra () also MUST be able to hear the results of vinyl demag'? Yet, to you, it does. AND, by your own lights, it cannot be shown he even passed a DBT on the amps anyway, no matter how suggestive it is that something could be up.
Gregadd
I never said that. Read the post again.

Terry
I do agree however (if this is part of your thrust) that as a result of that 'treatment' (which was shabby, as was the pear cable debacle) he is not likely to be disposed in doing another.

A pity and a shame, we all lose from that. No one wins.
Gregadd
Who said it was a contest?
Terry
I did not address this bit before, and you (again) did not choose to respond to the question of linking to the cable test in this forum (nor the withdrawal of your DBT protagonist). Earlier I asked you, and stressed my interest in, your personal reactions to any blind test you had been in.
Gregadd
I don't know where it is. I moved on. If you question its' existence you'll have to do the research.
Terry
You had however done a blind test between two audiophile cables and found no difference. Can you tell me your thoughts on it please? Perhaps a little explanation if inclined on the methodology.
Gregadd
I was then and remain a cable skeptic. I do not however think they are snake oil or a fraud for the most part. I was using a generic speaker cable and interconnect at the time. I was getting them for free. The dealer had offended me and was trying to make amends. They were his demos.
Terry
You seemd to think because they were 'audiophile cables' that I would have no interest. Not true. What I DO find interesting is that you found no difference. Do you too not find that interesting?
Gregadd
Not at all. What I did find interesting was that there was huge difference (sighted of course) between them and the generic cable.
Terry
Because this is what I deduce from it. (correct me where wrong). For a couple of very strong reasons I think you must have heard a difference sighted no? For starters, it beggars belief that if you had NOT heard differences that you would, nonetheless, go on to do a blind test between them. I mean for what earthly reason would anyone do that, let alone someone who is strong in the idea that blind tests improperly result in 'no difference results'??
Gregadd
I'll bite my lip about you questioning my veracity. I'll move on to the logic part. I was young and tried a lot of things that I don't do anymore.
Terry
And further, why would a person who in particular feels blind tests (of any description) very hard to set up and do, be the one to set up and do a difficult blind test between cables he already feels has no difference??
Gregadd
It was not I who said ABX/DBT was too hard. It was offered as an excuse by both sides of the debate why they don't do them.
It was just me listening to some for long periods of time to see which I preferred. A true DBT with a well formed hypothesis, truly DBT, with proper statistical analysis is a daunting task for those charged with the effort.

So, that is my reasoning, hope it bears some resemblance to the truth.
***
Truth? I thought it was opinion and argument.
 
Last edited:
Terry it is worth finding historical posts on this subject from both sides; JA points out the testing procedure was biased for several reasons, one not doing further tests beyond 5/5 as suggested should be done at the time by JA or MF and then also to statistically combine their results into a group average where their responses were lower, hence the average dropped.
Here you go: http://www.hydrogenaudio.org/forums/index.php?showtopic=71245&st=250&p=629443&#entry629443

And http://www.avsforum.com/avs-vb/showthread.php?p=20284861#post20284861
 
Terry
The point is that EVERY subjectivist is totally confident in their ability to make valid comparisons. That's why they 'don't need no stinkin blind test'.
Gregadd
Yes we are. Based on decades of experience.

Well then, can you explain why you did not hear a difference between cables blind when you did sighted?

I specifically asked you your reaction to that conundrum, whether it made you stop and pause OR confirm for you that blind tests were worthless.

Only because I am honestly curious, we seem to be in a bit of a game here....

Terry
Unless you are talking about a different situation (already mentioned I only know of one) HOW was he (MF) 'baited' into taking a blind test? The single one I know of was a group one, IIRC he got 5/5 and JA got 4/5, or so the reports go.
Gregadd

You're kidding, right?

No, I am not. I made it clear that I only know of one amp dbt he 'passed', it was a group seminar situation (or similar), hence how could he have been 'baited'?? AFAIK he agreed to such.

BUT, it seems you have knowledge of a second that I do not have.

Given that I don't know of the other, and that you know of this one, how was he baited in a situation like that?


Terry
(is this where I was correct?) Yes, if there was a true desire to find out, they should have been taken aside for further testing. And yes, you can make statistics say anything you want. Was it 'fair' to lump their results into a collective? Well, on a global level perhaps, but again if a genuine curiosity were there they should have had extra testing (if they were up for it that is)
.
I think this is half the problem, it is so 'combative'. Never end the allegations??
Gregadd
No comment.

Whatever.

Terry
You seem to be very selective in what you respond to BTW. I specifically asked 'why does him passing ONE test involving TWO ONLY amps somehow translate to meaning he, therefore, ipso facto and supra () also MUST be able to hear the results of vinyl demag'? Yet, to you, it does. AND, by your own lights, it cannot be shown he even passed a DBT on the amps anyway, no matter how suggestive it is that something could be up.
Gregadd
I never said that. Read the post again.

Ok.

The point Mr. Fremer has passed more than one test. He responded to a challenge much like the you issued me. To the claim that all amps sound the same. You are afraid to take the test because you know you'll fail. Despite scoring perfect it was dismissed as insignificant. "He must be some kind of freak." Even though he is till the subject of nasty personal attacks for claiming to hear improvements from things like demagnetizing his vinyl in sighted tests. You might recall his confrontation with our own Ethan Weiner.

(this also hints at knowledge of the second test I know nothing about..'more than one test') I have already agreed with you fully about the shocking response to his scores, but in any case here is the relevant part.. Even though he is till the subject of nasty personal attacks for claiming to hear improvements from things like demagnetizing his vinyl in sighted tests.

To me, that implies (taken in context) that as he 'passed' a blind test on amps it is reprehensible that he be subject to 'nasty personal attacks for hearing improvements from vinyl demag'.

So, I could have gotten it wrong, sorry if so. I took it to mean that he should have had some cred and as such his opinions on vinyl demag should be viewed as having higher value.

Terry
I do agree however (if this is part of your thrust) that as a result of that 'treatment' (which was shabby, as was the pear cable debacle) he is not likely to be disposed in doing another.

A pity and a shame, we all lose from that. No one wins.
Gregadd
Who said it was a contest?

See what I mean? HOW does that response follow from what you quoted?? It is completely non-sequitor.

Do you NOT agree that he received poor treatment?

Do you NOT agree that he would be less likely to go thru it again as a result of that?

Do you NOT agree that we all lose as a result?

"who said it was a contest"?? I mean, WTF?

Terry
I did not address this bit before, and you (again) did not choose to respond to the question of linking to the cable test in this forum (nor the withdrawal of your DBT protagonist). Earlier I asked you, and stressed my interest in, your personal reactions to any blind test you had been in.
Gregadd
I don't know where it is. I moved on. If you question its' existence you'll have to do the research.

Sad. No, I don't question it's existence (where did that come from?). Anyway, don't worry about it any longer.

Terry
You seemd to think because they were 'audiophile cables' that I would have no interest. Not true. What I DO find interesting is that you found no difference. Do you too not find that interesting?
Gregadd
Not at all. What I did find interesting was that there was huge difference (sighted of course) between them and the generic cable.

Hmm, I found it interesting that you found no difference when blinded, you however dispute that and instead you find it interesting there was a 'huge difference' when sighted.

Why are we playing these games greg?

So again, reconcile this big disparity between sighted and blinded, from 'huge difference' to 'no difference'. For all I know it could simply be that it confirmed for you the uselessness of blinded comparisons. It is not a trap, I am genuinely curious about your reaction.

Terry
Because this is what I deduce from it. (correct me where wrong). For a couple of very strong reasons I think you must have heard a difference sighted no? For starters, it beggars belief that if you had NOT heard differences that you would, nonetheless, go on to do a blind test between them. I mean for what earthly reason would anyone do that, let alone someone who is strong in the idea that blind tests improperly result in 'no difference results'??
Gregadd
I'll bite my lip about you questioning my veracity. I'll move on to the logic part. I was young and tried a lot of things that I don't do anymore.

WTF? Veracity? I was explaining my reasoning! Which, funnily enough, turned out to be entirely true!

Terry
And further, why would a person who in particular feels blind tests (of any description) very hard to set up and do, be the one to set up and do a difficult blind test between cables he already feels has no difference??
Gregadd
It was not I who said ABX/DBT was too hard.

Again, my apologies. I would not find you saying anywhere how hard it is to do it properly? That that also means the results from purported DBTs are inherently unsafe? Should I look or not.


It was just me listening to some for long periods of time to see which I preferred.

Excellent, at least we can out that one to bed. Short listening and all that, how that could be one of the fatal flaws of dbts.

Progress.

So, that is my reasoning, hope it bears some resemblance to the truth.
***
Truth? I thought it was opinion and argument.

That all my reasoning turned out to be completely true, then yes, I agree with you. It does seems to be a lot of argument (for arguments sake)
 
Terry
The point is that EVERY subjectivist is totally confident in their ability to make valid comparisons. That's why they 'don't need no stinkin blind test'.
Gregadd
Yes we are. Based on decades of experience.

Reminds me of a discussion between Popper and Adler

Once he reported a case to Adler which did not seem particularly Adlerian to Popper. Adler readily analysed the case in terms of his own theory even though he had never seen the child in question. Popper asked how he had been so sure of his analysis, and when Adler replied: "Because of my thousandfold experience," Popper couldn’t help saying: "And with this new case, I suppose, your experience has become thousand-and-one-fold."
 
Reminds me of a discussion between Popper and Adler

Vincent-When I was in college I went to a young doctor for an eye infection. He gave me an eye wash and a prescription for new glasses. I passed on the glasses. The infection went away. It came back. I was referred to an older doctor. He had all the fancy equipment of the younger doctor, he never used it on me. We sat and talked about college for a while. I asked him about the eye. He replied, "stop eating so many cookies." I purchased the eye wash again. The infection never came back. Experience!
 
Are you sure it wasn't brownies and not cookies Greg? ;)
 
Terry No offense intended. It does appear that in your zeal to win the contest or be right you misconstrued the facts. I never did a blind test of generic vs. audiophile cables. The superiority of the audiophile cables to the generic ones was obvious to me.. The blind test was between the two audiophile cables only.

AMIR provided a thread on Hydrogen Audio , above that includes Michael Fremer, John Atkinson and Arny Krueger. Mr. Fremer claims to have participated in over 100 blind tests including a visit to Harman International with Dr. Sean Olive. See post #451.

The point is not that Mr. Fremer passed the test, but that he responded to the challenge of ABX with absolutely no resolution of the debate. Frankly it got worse. If he had failed do you think he would have changed his mind?
 
Last edited:
Are you sure it wasn't brownies and not cookies Greg? ;)

I did like those Little Debbie Brownies. What a drug pusher she is.
 
Well, cookies, brownies, they both made me fat. On with our regular programming! :)
 
In my view, attempting to conclude anything useful about audio from a face-off of Fremer and any of the stalwart extremists from hydrogen audio is a waste of time. It's like trying to develop an informed world view by watching an argument between Keith Olberman and Grover Norquist.

Vincent-When I was in college I went to a young doctor for an eye infection. He gave me an eye wash and a prescription for new glasses. I passed on the glasses. The infection went away. It came back. I was referred to an older doctor. He had all the fancy equipment of the younger doctor, he never used it on me. We sat and talked about college for a while. I asked him about the eye. He replied, "stop eating so many cookies." I purchased the eye wash again. The infection never came back. Experience!

If guys like Fremer set your standards, and you see HA, not simple reason, as the opposition to that, it's a small wonder so many of you guys keep buying the glasses.

Tim
 
Actually, I don't know what's stranger, a bunch of guys waxing poetic in a darkened room or a bunch of guys shuffling gear around promising not to peek.

Come to think of it. I think the latter is stranger.
 
Status
Not open for further replies.

About us

  • What’s Best Forum is THE forum for high end audio, product reviews, advice and sharing experiences on the best of everything else. This is THE place where audiophiles and audio companies discuss vintage, contemporary and new audio products, music servers, music streamers, computer audio, digital-to-analog converters, turntables, phono stages, cartridges, reel-to-reel tape machines, speakers, headphones and tube and solid-state amplification. Founded in 2010 What’s Best Forum invites intelligent and courteous people of all interests and backgrounds to describe and discuss the best of everything. From beginners to life-long hobbyists to industry professionals, we enjoy learning about new things and meeting new people, and participating in spirited debates.

Quick Navigation

User Menu