The scope probe is picking up 11 kHz, while the acoustic camera showed 22 kHz. So chances are the scope probe still pics up an electromagnetic field, not acoustic.
The scop probe may have an MLCC inside, but that would be a low value (e.g. 5-10 pf) C0G type and these are not piezo electric.
The effect from hitting the probe is more from plastic isolation. Plasticaly deformed PVC and some others (PTFE ?) can become piezo electric. Another part is triboelectric charges in the cable - directly and as trapped static charges with changes in the capacitance.
A scope probe to detect vibrations would still be a nice project. One could use somerhing like a small piezo element, e.g. from an acoustic delay line or maybe cut up a beeper disc. An old turntable pickup (e.g crystal type) may also work. These are much more sensitive than a MLCC that is made to minimize the piezo effect.