It is the display connector. See the first photo
on this page. It's a little bit hard to see since my photographing skills (and gear as well) can be improved on... It's the brown polyimide flex PCB that first sneaks up and then down in the right front-area cutout of the main metal chassis of the instrument.
I don't think that the FPGA's JTAG interface will be that helpful regarding the calibration issue. The ominous three-pin footprint labeled "J2" on the processor board looks like a much more promising candidate to me. Pins 1 and 2 are routed via a resistor each and then vanish in the direction of the CPU. Pin 3 is connected to ground. Could very well be an UART interface with 3.3V CMOS levels.
Edit:
Just had my DG800 apart and hooked up to J2 (first Scope, then UART interface): 1 - TxD, 2 - RxD, 3 - GND. 115200/n/8/1, no handshake. I recorded the bootlog without the front panel attached so I assume this causes the I²C errors:
U-Boot SPL 2015.07 (Jul 17 2018 - 16:15:46)
Jumping to U-Boot
U-Boot 2015.07 (Jul 17 2018 - 16:15:46 +0800)
Watchdog enabled
I2C: ready
DRAM: 256 MiB
NAND: 512 MiB
MMC: OMAP SD/MMC: 0, OMAP SD/MMC: 1
Net: MAC addr->F4:E1:1E:A1:E5:CC
get PHY for cpsw: addr 1
cpsw
Hit any key to stop autoboot: 1 0
Booting from nand ...
NAND read: device 0 offset 0x400000, size 0x9140
37184 bytes read: OK
NAND read: device 0 offset 0x500000, size 0x409000
4231168 bytes read: OK
crc_format = bootm 0x82000000 - 0x88000000.
## Booting kernel from Legacy Image at 82000000 ...
Image Name: Linux-3.14.26-rt25
Created: 2018-07-19 9:09:58 UTC
Image Type: ARM Linux Kernel Image (uncompressed)
Data Size: 4231104 Bytes = 4 MiB
Load Address: 80008000
Entry Point: 80008000
## Flattened Device Tree blob at 88000000
Booting using the fdt blob at 0x88000000
Loading Kernel Image ... OK
Loading Device Tree to 8ef17000, end 8ef23132 ... OK
Starting kernel ...
[ 0.527343] mtdoops: mtd device (mtddev=name/number) must be supplied
[ 0.600253] cpu cpu0: cpu0 clock notifier not ready, retry
Starting logging: OK
mount user space...
Starting mdev...
modprobe: can't change directory to '3.14.26-rt25': No such file or directory
Initializing random number generator... [ 4.243743] random: dd urandom read with 7 bits of entropy available
done.
Starting network: OK
Starting dropbear sshd: OK
Starting sshd: /var/empty must be owned by root and not group or world-writable.
OK
Starting app...
[ 4.884799] sardine-adc TI-am335x-adc: initialized
Welcome to RIGOL DG800 system
rigol login: [ 4.964771] fram 0-000a: initialized
[ 5.022452] beep pwm:beeper,hwpwm:0,period:2000,polarity:0
[ 5.032691] pwmdev-beeper beeper.7: initialized
[ 5.085729] gpio-led led.8: initialized
[ 5.783576] ts-ft6336U 2-0038: ts_ft_i2c_write i2c write error.
[ 5.789953] ts-ft6336U 2-0038: ts_ft_i2c_write i2c write error.
[ 5.796808] ts-ft6336U 2-0038: ts_ft_i2c_write i2c write error.
[ 5.803105] read: i2c_transfer error!
[ 5.807276] ts-ft6336U 2-0038: ts_ft_i2c_write i2c write error.
[ 5.813561] read: i2c_transfer error!
[ 5.817751] ts-ft6336U 2-0038: ts_ft_i2c_write i2c write error.
[ 5.824049] read: i2c_transfer error!
[ 5.829168] input: Rigol-FocalTech TS as /devices/ocp.3/4819c000.i2c/i2c-2/2-0038/input/input0
[ 5.925523] input: rigol keyboard as /devices/ocp.3/48022000.serial/input/input1
[ 5.954777] rigol-kbd 48022000.serial: initialized!
[ 6.035074] usbcore: registered new interface driver usbtmc
[ 6.114785] usbcore: registered new interface driver asix
[ 6.164791] usbcore: registered new interface driver r8152
rmmod: can't unload module 'usbtmc_dev': No such file or directory
rmmod: can't unload module 'libcomposite': No such file or directory
[ 22.312471] Rigol Device gadget: Usb device Gadget, version: 2016 July 26
[ 22.319781] Rigol Device gadget: Rigol Device ready
[ 22.420986] usbcore: deregistering interface driver usbtmc
[ 22.534791] usbcore: registered new interface driver usbtmc
[ 30.679919] random: nonblocking pool is initialized
I may install a wire to J2 and run it outside so I can use the instrument with an UART interface attached. Let's see where it takes us...