Unlike some guys here (especially PeterA), who have managed to eliminate acoustic treatments from their rooms, every single time I think I can get away without absorption on front wall and side wall reflection points, the results in hardened SQ means back in they go. And now absorption on the eaves proving to be a benefit.
Marc, I found it was very difficult to find a good speaker position when I removed all the sound treatment and eliminated tow in. But the result was very well worth the effort.
Have you ever experimented with moving your speakers away from the sidewalls and pointing them straightahead? You may find the hardness changes and then when you remove the sound treatment the sound will open up and sound more natural.
Ignore the advice if you’ve already tried it. Perhaps your speakers sound best pointed right at you and spread wide apart in the room.