Sensitive DMM will pick up every stray EMF out there. To eliminate it, remove the impedance between the probes tips so there is no potential difference between them, this is done by shorting it, as you did, it then stops.
If you had an oscilloscope, you can actually see the waveform of the EMF, usually it picks up line voltage radiation at 60 Hz, in the USA.