Granite or ceramic sand does a number on drill bits quite quickly. No need to use fibres, unless you add short strand chopped aramid fibre ( kevlar cloth) for added rigidity between a inner flexible potting compound and a rigid exterior potting. If you really want to fool them blow a few diodes open circuit and add across power rails.
If you are really anal a fine grid of insulated copper wire scramble wound around it consisting of 6 strands to assorted pads where they supply power, ground, sinals and no connects will defeat most depotting methods. Used in the bank crypto modules for that purpose, though there it also has the keep alive circuitry power through it.