Comment by evilmathkid

> You mean for a specific usecase?

Yepp

> Also aren't frontier models trained 'from scratch'?

The full sentence was supposed to be "training from scratch only on ARC data"

the point was you dont need large scale pretraining