All we ever see is these autonomous cars doing (relatively) basic stuff, as advanced and impressive as that is of course, again it's not anything close to what a human is capable of.
Well, the proof of the pudding is in the eating. We'll see.
Can't say I've seen one get out of the way of an ambulance. Pull over when the cops point their finger. Notice that someone is walking toward their car and is about to hop in and so wait for a minute.
I've heard them mention all of those scenarios saying they can handle that. The Waymo cars have microphones that actively listen for sirens, they can recognise emergency vehicles and they will take appropriate actions to let them pass. They use neural networks to predict if someone is about to get into (or out of) a car, and I've seen a video of the cars following the commands from a traffic police using hand gestures in an intersection.
Car being directed by traffic cop at an intersection with broken lights:
Car predicting intention of bicyclists, slowing down to let them pass:
While the cars don't rely on neural networks to determine if there is an obstacle on the road in front of the car (that is what they use the lidar for)
The Tesla doesn't have a LIDAR, and Musk recently said any company who uses one is doomed.
But the Tesla isn't a self driving car, it has some fancy cruise control (classified as level 2) and they kill people regularly. Tesla doesn't use lidar because it would be too expensive to put into all their cars. Everyone else does though, since they are not making cars but drivers (full level 4 autonomy). Waymo and GM develop their own in-house lidar systems.
It's not the twisty crowded roads, it's the rain, hail and snow. The lidar is famously blinded by heavy precipitation.
I remember driving home one night from the city. It was raining hard and Sydney's streets were more than their usual nightmare with nighttime road works, huge flood lighting blinding everything, and contraflows galore that even I had a hard time figuring out. And I remember thinking that an autonomous car wasn't going to be able to handle this within my lifetime.
Maybe if it tailgated the car in front that would be a sensible AI tactic, but on it's own no freaking way.
They can handle light rain, but in heavy rain they pull over and stop. That is clearly not a long time solution and it will probably be a while before they solve that problem. Since the lidar is blinded in that situation (and I don't see how they could fix that) they would have to rely only on cameras and radar, and as we have seen from Tesla, they can't drive safely with only cameras and radar. A lot of progress has been made on computer vision in the last couple of years though and vehicle radar is getting better as well. They will probably get there eventually, but it's hard to predict when, it could take 10 years or 30.