You are correct. FR is only part of the picture. The time domain is the part many folks ignore. I think it's as important, if not more so, than FR. That's why I posted the impulse response before and after. They are interrelated. I also think gear matters.
But the low-hangin' fruit in high end audio is speaker/room interaction. It's the last food group most folks consider eating, if ever. The healthy eating analogy is apt. It's not as profitable for a food company to market whole meats/veggies than it is to sell mass produced refined grain products. In high-end audio, nobody is making a killing selling acoustical test gear, room treatments, DSP or acoustical advice. The big money is made with the electronic gear. Consequently, the gear sellers rule the roost in marketing, opinion making and dealer education.