Reading between the lines you are saying the important thing is not 'what's best practice' but rather where they have tied ground for the oscillator drive inside the chip?
The datasheet says a single ground plane can be used, but I don't think it will be optimal. I have a PCB like that from AliExpress and it has some noise. Certainly any input / output buffers and filtering will work best when nowhere near digital ground currents.
Yes, I'm saying the most important thing is that there is a short return current path to the IC's crystal oscillator circuitry (refer to Doctorandus_P's post).
The IC has four power domains: IOVDD, VDD, VDDA, and VDDP. Inside the chip, there are likely antiparallel diodes between all of the GND domains, or perhaps they directly tie them together or use a resistor between domains.... Between voltage nets, there will be antiparallel series diodes (to account for the voltage differences between domains).
The critical factor is to reduce loop areas. If you tie the capacitors to the wrong GND pin, the return ground current will have to flow far away through the point of connection between the planes (or the capacitance across the IC's internal diodes or the decoupling capacitors you have populated). This would create a large loop, creating EMI/EMC issues.
I think your initial question should be rephrased as: Should the VDDP domain be tied to the digital or the analog plane? The modern answer is to use a single GND domain. My guess is you'll get better performance with it tied to the VDD/VDDIO GND plane versus the GNDA plane, but expect the single plane to be best.
Also keep in mind that the interconnection between GNDA and GNDD has to be under the DSP IC, and that all tracks going across domains have to cross in proximity to this interconnection.
For the cleanest routing around your crystal, put it very close to the pins, and put it on a very small GND plane that is connected to the big GND plane only at the crystal pins of your DSP chip. This ensures that no currents flow thought the GND plane under the crystal (Except the crystal signals themselves) and also te crystal caps connect here to each other.
According to some, it's even better to just make a hole in the GND plane around the wires to the crystal. When there is no other copper, then there can also be no capacitive coupling.
I'm not sure I undertand your description. Could you draw a diagram or something, please?
Look at TI application note SLAA322B figure 7. You use an isolated GND plane under the crystal & capacitors.
The best likely would be to not split the ground. As in most cases it does more harm than good.
I'll have to watch that later, but FWIW this is an audio frequency board in the analog domain. Ground impedance is everything, no HF effects to keep current near the signal traces.
In this case, it's a sigma-delta/delta-sigma ADC&DAC. They'll operate at many MHz, and are in the analog power domain.