That might muffle the noise a bit, but you'll have a hard time quenching off the noise itself unless you put a screw clamp on them or something like that.
Generally speaking these effects aren't harmful to the components if you don't exceed their ratings and then some. They're just annoying. And, in case of piezoelectricism, can inject unwanted noise into your signal path (microphony).