Google "HP step attenuator repair." There are some articles, YouTube videos and eevBlog posts that might help you. I don't know the part numbers of the individual pads, and even if Keysight has any for sale, so you might be forced to buy a similar old HP attenuator (on eBay) and salvage the parts. But I would start with a gentle cleaning and inspection of the plunger's O-rings (if the attenuator is the kind that has them). I doubt there is a way for an average user to "fix" an individual pad.
Fortunately, my unit has the electronic attenuator, not the mechanical one, so I am spared this ordeal. Good luck.