The problem will be the same without a ground pin.
The source is from small caps from the output ground to both lines of the mains input. These are kind of required to meet EMI requirements for a switched mode supply. So you should find this with many other parts, when there is no ground.
So not have ground connection can cause a similar problem with other instruments too, that are normally grounded.