I have come to believe there are 3 fundamentals to deal with first and foremost:
1. Power
This is a vast subject, and in it, I include dedicated lines, balanced power or isolation transformers, AC conditioners/filters, linear power supplies, proper chassis grounding and additional 'grounding' schemes like what Entreq does for the signal planes.
Inevitably, cabling (and not just the power cables since grounding issues can transfer over near your small signal cabling and then get amplified...) is crucial here.
2. Vibration Control/Isolation
I posted a more in-depth exploration of what's needed for this, but basically: internal vibration control, component-to-component isolation, air-induced vibration isolation or damping, seismic isolation.
When you get the Power right, you also need to combine vibration isolation/control for your power, especially if you have an AC conditioner.
3. Room Diagnosis and Organic Treatment
Quite a vast subject as well. The amount and nature of treatment here is related to the room's construction as well as to your speaker construction.
The room response should be measured with something like R.E.W. (highly recommended and free) and a good microphone.
From there, the largest peaks and troughs deviating from a smooth and flat response should be identified and treated.
Treat bass response first as there is a lot of energy in these regions and since they are non-directional, they linger on. For organic treatment, glass fibre in room corners works well.
With common speakers, then you can consider treating the first reflections, and additionally include a diffusion panel.
Do not immediately head for DSP room treatment when doing this, but strive first to tame the room response with analogue, organic treatment. Don't deaden the room. Use additional DSP if and only if there is at least one troublesome peak/trough that is still giving you a hard time and organic can't tame it. Only use common DSP if you're listening to PCM (until DSD processing becomes more available - not easy but doable in digital, easy in analogue).
And the Zeroth requirement:
0. Learn to listen
This requires stopping the focus on frequency perception, and rather also incorporating notions like timbre accuracy, soundstage accuracy, transient reproduction, rapidity and accuracy of transients, accuracy of reverb tails, 'presence', 'holography', 'reality'.
It helps to acquire the 'Hi-Fi' mindset, i.e. the pursuit of your equipment providing as close as possible the experience of a live environment, or the microphone feed, or the master 'tapes'.
For that, it is necessary to calibrate your ears to live, acoustic music from time to time. This is helpful even if you listen preferably to electronic music.
Also, instead of stale 'digital vs analogue/vinyl' discussions, ask the other party instead 'What are you listening for? What are you hearing that makes you like it?'.
Only after these come the rest, things like Amp + Speakers and DAC.