But isn't it easier to replace the broken stand-off with a normal one with nut and washers?
They are the same used in the DB-9/DB-25 connectors for RS-232.
Apart from the problem of finding an identical connector then you should remove it (which is not easy without suitable equipment) risking damaging a multilayer pcb.
Well normally I just screw a replacement stand off in (I have accumulated a selection from faulty PCs and cards over the years) but the hole on this connector is not threaded and also the hole is a larger in size than the stand-off so they just don't fit very well.
Currently the display output is either yellow or Magenta in colour but if you pull up on it the image is normal so it needs re-soldering anyway, I may as just well replace it.
Replacing the connector is the easy part for me. I have done loads of D-sub and VGA connectors before but never encountered these "shorter" smaller form factor type on regular desktop PCs. Just on this HP server which is odd. Once I source a new connector it will be an easy fix.
When I replace these connectors I just re-flow the joints using lead based solder with my iron, then wick away the solder on the two supporting lugs.
Then I use Kapton tape to mask around the joints and use hot air tool to melt the solder on the pins and the connector just pops out.
Then clean the area with IPA and install a new connector.