Comment by TZubiri
5 days ago
>Personally I think today's frontier models can be beat by training from scratch
You mean for a specific usecase?
Also aren't frontier models trained 'from scratch'?
5 days ago
>Personally I think today's frontier models can be beat by training from scratch
You mean for a specific usecase?
Also aren't frontier models trained 'from scratch'?
> You mean for a specific usecase?
Yepp
> Also aren't frontier models trained 'from scratch'?
The full sentence was supposed to be "training from scratch only on ARC data"
the point was you dont need large scale pretraining