I've had this before, too. And it was reported by someone else before, tin whiskers were suspected. Goes away by applying some voltage.
When I tried to use that particular probe (indeed a bunch of probes were affected), I was quite confused until I discovered the short.