Comment by 1024core
4 years ago
See the "joke explaining" examples on Page 36 of the paper: https://arxiv.org/abs/2204.02311 and tell me if it's just "passable garbled nonsense".
4 years ago
See the "joke explaining" examples on Page 36 of the paper: https://arxiv.org/abs/2204.02311 and tell me if it's just "passable garbled nonsense".
> 500 bn parameter model
That solution has a compressed representation of half the internet.
NNs are "garabled nonesense" insofar as they try to generalise; insofar as they are search engines, they provide apparent sense by just repeating something in their database (= weights).
Google, likewise, returns joke explanations.
"The Internet" is much, much bigger than 500bn floats. The latest snapshot of archive.org has 505 billion web pages itself.
That's astonishing.
Oo this reminds me. One of my favourite sci-fi novels is The Moon is a Harsh Mistress.
In it, it depicts the growth of a nascent AI from its attempts at understanding humor. The AI befriends a technician and gets the human to rate its own crafted jokes.
Eventually the AI gets really good at telling jokes, and becomes sentient as a result.
It was a very fun take on AI gaining sentience, highly recommended!