Comment by Jean-Papoulos
3 hours ago
>The harder question, in Chollet’s framing, is: how efficiently can a system learn to do something genuinely new?
The more diverse stuff it knows, the easier it will be to learn something new.
3 hours ago
>The harder question, in Chollet’s framing, is: how efficiently can a system learn to do something genuinely new?
The more diverse stuff it knows, the easier it will be to learn something new.
While humans can do this, it has historically been difficult for machine learning models to manage it.
It is unclear if Transformers are "it" or not, because while they are much more general, they are also very spikey intelligences despite having read almost everything the trainers can get their hands on.