If the probe ground is connected to the chassis ground, which is the only safe place in this case, then the probe tip can be applied anywhere safely.
The problem comes when trying to measure the voltages on the primary side because common is *not* at chassis ground potential. So measuring the primary side voltages to the primary side common requires an isolation transformer, floating input, or a differential probe.