Well for digital to be tolerable it starts with power conditioning. And that isn't easy since few are really worth much. Its complicated in that there are lots of compatibilty issues.
Agreed that digital tends to greatly benefit from good power conditioning. I have a $400 Tripp Lite isolation transformer (1000 W) that is medical-equipment grade (the audiophile stuff is mostly overpriced, imo). Works great.
Next you need a DAC or CD player with a good one. The DAC can be fed by an Oppo or a slew of computer stuff, you're in for at least $500 no matter what. The DAC is tough, I can't think of anything under $2k worth much. Even then I don't have any good answer for something I recommemd off the top of my head besides high end MSB maybe. Many things need mods to really be worth it.
I have a CD transport, Simaudio Moon 260 DT, for $ 1.8 K, and a Schiit Yggdrasil DAC for $ 2.3 K (the price of the latter benefits from it being a direct sale item). Digital AES/EBU cable is MIT Proline ($ 1.4 K, I got it used for $700). That's a total of $ 4.8K (with the used cable). Highly resolving, highly involving, and remarkably free of digital artifacts (you really would have to look hard to find some if there are any). I'd be very surprised if a vinyl set-up (incl phono stage!) for that price could compete with it. Obviously, a $ 50 K vinyl set-up is in some ways a different ball game when it comes to reproduction.
Vinyl you can get a table used for $400, do a little dampening, get a power conditioner like SurgeX, and lots of phono preamp options that sound pretty good at nearly any price. Results will be very nice if chosen wisely. Its cheap to do stuff like stacking some plywood or whatever, lots of ways to add mass etc.
That of course is tweaking, and not everyone can do that. I have no doubt that it can sound 'very nice', but highly resolving, musically accurate and with competitive dynamics? Doubtful.