Actually it's a wide ranging subject touching on circuit design and layout and hardware (power supply).
It is well known anything PC related is noisy despite the hype in terms of data acqusition. It is analog signal in real life. Depending on the type of signal small or large aquired using a linear supply saves you headaches.
Then take the chance as it gets to PC unmolested.

In theory having host PC and data acquisition device on same ground is prefered as the ground noise is referenced to same ground. For a more detail treatment
try to download an old copy of Henry Ott's Noise Reduction Technique in Electronic Systems 2nd. edition.

There are tons of articles on noise online.