A bunch of series resistors...
Build a divider, 2kV is not as much as you think, I don't know how much current you device puts but you can put 20 1MΩ resistors in series and measure upon the last one. If it's loading it too much twenty 10MΩ resistors could do better, or at least with both measurements you could tell the output impedance of the fence. Then read with your DMM, note than the DMM input impedance is probably about 10MΩ, so you can get a rough number with the 1M divider but for the 10M is a bit harder, the DMM could be the last resistor but you would need to measure it with a second DMM or you could try measure the current, 10µA would be your 2kV with the 20x10MΩ resistors.
The build of the probe is the more problematic matter, you could solder them in series in plain air and place them in a tube, The best choice will be to use some teflon spacers inside the tube, as using a teflon tube would be pretty expensive for your application. The tube could be PCV, or just use a PCV pipe with the end caps to hold both ends of the resistor string. In the 10MΩ version you just need access to the last one to measure current... well, this also applies to the 1M as you can do the same thing but now on 100µA for 2kV.
JS