Comment by torginus

But what might happen imo, is that these huge models might be much better at learning from data in an unsupervised manner, so a model based on Astra might become a much better driver in a short period of time (and given a smaller set of training data) - this is due to it understanding much more of the inputs, and being able to draw conclusions from it much more efficiently, thus the information available for training it is greater per sample.

Then the big model can teach a small model to become almost as good a driver. This might be substantially more efficient way to train stuff, and might be fairly quick and straightforward.

In practical terms, I feel this means we can see huge jumps in capability overnight. And this is a general indicator of AI progress, not only in this narrow scope.