Have you experimented with a crossover to augment the "mechanical crossover" the horn provides?
IMO, it can be done without any major downsides. I use a Clarity CSA cap combined with a Jupiter copper foil cap, and a foil inductor in parallel to make for a 12 dB electrical slope. With my setup the mechanical slope is pretty pronounced as I use a 4.5" driver... the horn has much more of an effect as far as boosting efficiency vs an 8" driver... so I end up with a pretty steep slope overall, which works very well with a 24 dB slope on the woofer. The downside of the 4.5" driver is it's not as good at producing lows vs an 8" so the xo is needed more, but I have found some major improvements in playing complex music via the crossover. On the high end too, I now have a 1st order low-pass at 12 kHz so there's less overlap with the Fostex T500 tweeter, this has done a lot to clean up the highs and again the result is better performance on complex music, violins and female vocals are far clearer as well, at this point I'm very close to the TAD coax w/ Be tweeter in portraying female vocals by implementing the crossover.
I know AER and other single driver manufacturers continue to toe the line that xo's are all bad, but if you use good parts and implementation, I think this is not the case. There is simply no possible way a single driver can handle the frequency extremes as well as dedicated units. To be fair, it wasn't that long ago where it was difficult to find conventional speakers with properly implemented xo's that didn't cause problems, so it's not all BS, but otoh I do think a system with a well designed woofer, tweeter and crossover is going to surpass any single driver.