Comment by ForHackernews
14 hours ago
> unlike a human, their overall capabilities grow over time
This is incorrect. Unless there is some new developments I'm unaware of (entirely possible) LLMs "learn" during the training phase, but after that they are static. They do not improve further or retain information when used for inference.
You might be confused because AI companies keep releasing new models and tinkering with the harnesses, sometimes under the same name such that "Zern 6" (or whatever) doesn't always mean the same thing.
Nah, I just phrased it a bit confusingly - I meant the capabilities of LLMs as a technology (equivalently, the capabilities of whatever the frontier model is at each time) grow over time, even though any particular model is static.
They grow over time if you consider a lineage of models as the same model.