I've had the opposite experience. I find the HiRez files for many labels sound far superior to the CD equivalent.
The DAC being used for replay from the Music Server has an impact and I find that linear phase filters used by many sound digital. Trying filters that are not linear phase make a big step in sounding better for digital replay.
I built a DIY DAC using the AKM AK4490EQ DAC and Async USB interface which has reconstruction filters that are not linear phase. It was in the DIY room at CAF2016 and driven by a Linux based music server, sounded very good and played HiRez files. Had lots of comments on very good sound quality for HiRez replay files and CD files.
When you can find identical CD and HiRez files from the same master recording, in playback the HiRez has always sounded superior.
The entire vinyl vs digital write-up has to many differences in mastering requirements to be a comparison. You may have a preference, but they are not identical to start.