Yes. Unfortunately, the CMRR is not infinite across all frequencies... The issue that has been seen is basically shorting a noisy PC ground to a sensitive DAC (or preamp) box and injecting noise into the signal circuits that reference a single ground plane. The better boxes use some sort of galvanic isolation. For the record, I do not use an external DAC; I have run into this several times with microphone preamps. Others here have seen/heard problems with USB DACs.
I have seen (measured) USB lines that have fairly high CM noise, but I do not know if that impacts the sound (I do not have a DAC box to measure and it would depend upon the USB receiver design anyway).
I have seen (measured) USB lines that have fairly high CM noise, but I do not know if that impacts the sound (I do not have a DAC box to measure and it would depend upon the USB receiver design anyway).