Comment by manquer
3 hours ago
How is being faster equating to more intelligent . Speed can achieved in a lot of ways for lot of tasks, a simple lookup table can fasten most algorithms but that doesn’t make them “smarter”.
3 hours ago
How is being faster equating to more intelligent . Speed can achieved in a lot of ways for lot of tasks, a simple lookup table can fasten most algorithms but that doesn’t make them “smarter”.
Most of the interesting tasks these days require a lot incremental work and tinkering. Basically the whole thesis is to build models that can spend a lot of time tinkering, and measure how long they can go while still producing useful results. You can kind of break it down into two axes:
1. How long can the model work and still make progress 2. How fast does it get to interesting places.
We see N -> N+1 models getting better at (1), but it does take more work to measure because you need to come up with well specified useful tasks that inherently take longer to do.
However (2) is very easy to measure, because you can keep using the evaluations you used for the previous generation of models and see if the new system gets there more easily. This is a very useful measure of progress.