Photo of the other side, likely the transformer is running at close to saturation, as only one magnetic pole will drive it into the region where you get noise. Possible causes are a missing air gap shim, a cracked core or side or the material has warped. If you cannot fix those use a small ferrite magnet to apply a bias to the core to keep it out of saturation, that is often done on pot cores to keep them in a linear or low loss portion of the BH curve.