that is why they put those ring of capacitors around the rectifier I think? Hp always has a few capacitors, not always four, sometimes 3 (muntzing?). I am almost certain once I thought I had to replace four but then there was only three.
Something like 1 to 10nF.
Sometimes they have a cap across the transformer (ceramic) that likes to make acoustic noise, sometimes they also have caps across the diodes. Their old RF things IIRC have 4 caps right around the rectifier, but on things like power supply I have seen that arrangement but the caps are like a inch away on the rectifier/capacitor PCB. I wondered why this was, because they could have put the capacitor right there, but instead it was farther away. I wonder if it is using the inductance of the trace or something. And I think it had a separate trace back to the transformer pin (like a star connection) rather then looping back across just the diode...? I mean it felt like they had to go out of their way to make it like that instead of just putting it across the diode. I need to try to remember which unit that is. Could it have been the HP current source 6177.. possibly the A version which got dispatched for being a nuisance

(the remains are in a 'canopic jar'. )
Maybe just start with 4x 1nF 500V SLCC caps around the rectifier and see if it goes away ?
Those tiny ceramic capacitor on the rectifier/capacitor board are the ones that sing, they always give me a problem, making me replace them with foils. But do they do their job, I am not sure, because the SLCC capacitor "bandwidth' is huge

also it could be related to shortwave RF
http://www.ll-leasing.com/pritch/shortwav.htm