Comment by Findecanor
3 days ago
This is a classic case of: if the situation is not in the training data then the model is unequipped to handle it.
We've seen the phenomenon before. We've been warned against the phenomenon before, and we'll see it again in other contexts in the future for sure.
This goes for humans just as well. Humans get stuck. That waymo paused their op to avoid bad press and then get bad press BECAUSE they were being careful is enormously stupid for everyone involved.