It is not fun for anyone to do rigorous tests. I am sure it is no fun in the medical industry either. But if we want data and not falsehoods, and proceed to convince others on forums, then it is required work. Fun or not.
The great way to avoid doing such tests by the way is to take the time to learn the technology and psychoacoustics, and make determinations based on that. I find that enriching to know more about the audio than the day before by reading someone's research or learning from their knowledge. It is for this reason that for every hour of testing I do, I listen and enjoy 1000 hours of music.
We all share the love of music and attempting to say that some of us don't and love to test is uncool. Really uncool.
Yes, this is a very good post about a key point. I too don't like doing rigorous testing. It is no fun. And I don't do elaborate ones for the most part. However, just recently someone did a big comparison of DACs. I asked about level matching. It was done by ear, I politely indicated the problems with it. The OP politely acknowledged that and said he wouldn't level match because it was no fun. Yet it throws the entire comparison in doubt (in my mind). The level matching required a mutlimeter and test tone. The time to do it would have been no more and perhaps less than matching by ear. Yet the results would have meant more. Why not do it? That one thing, level matching pays big dividends, but many seem philosophically opposed at doing any such thing.
How does simple steps to make comparisons valid make us non-music lovers? Yet you see that claim over and over. Heck if I didn't care I would willy nilly listen to anything anyway and make no effort to be more effective.