Comment by 10xDev
5 days ago
No, the unsolved problem of AI is continuous learning. We never stop learning, we don't have a "training phase". You are always updating your world model even when you sleep. Also more quality training data does lead to greater learning efficiency as you have more priors to work with.
>We never stop learning, we don't have a "training phase".
We kind of do, if you count critical periods in childhood.
Probable mechanism: "What we found is a rapid increase in GABA in children, associated with learning, ..." [1]
[1] https://www.brown.edu/news/2022-11-15/children-learning
Why not both?