I’ve had a FiiO K5 Pro for a few months now and it’s worth every penny. Works with Linux out of the box and I can’t detect any noise.
Also a good choice would be an iFi Zen Dac.
Both are connected via USB only. However, an additional power supply is mandatory for the FiiO.