Wow, only watched about 30 mins so far, will have to catch the rest later but I love love all the details on the SoC itself, die size, fab node, floor plan, etc. This must be the project that Jim Keller* was working on. I absolutely love the details of chip designs and stuff, and am surprised they have come forth with so much info, definitely very cool! They obviously designed this chip for running a very specific workload and optimized the absolute crap out of it. The NN accelerator is very lean. Does exactly what they need and nothing else. I wonder what GPU IP they used, based on the floorplan it looks like a MALI or maybe PowerVR design, (and maybe they reveal it later in the video, I haven't seen it all yet), but it would be very interesting if they designed their own GPU IP. I kinda doubt they did because that's not really the focus here, the neural network accelerator obviously is and that is definitely all custom, no point in designing a GPU IP when an off the shelf one is fine for what they need. I like the the quad-core clusters of A72's here, they look to have quite a bit of cache as well. I wonder if they are using an off the shelf ARM interconnect there or if they have rolled their own for that. I'd guess it's a CCN-500 series although I'm not sure. I wonder if they will move to one of the newer designs in the future allowing fewer larger clusters (perhaps 2x 8core A76 clusters in next gen).
*Jim Keller was the brains behind some very successful chips like some of the Alpha designs in the 90's, AMD K7 Athlon, AMD K8 Athlon 64, Apple A4 and A5, and AMD Zen. He is now at Intel, purportedly working on their push into discrete graphics.