Comment by rambambram
1 year ago
> If the text that the text-generating tool generates contains reasoning, then the text generation tool can be said to be reasoning, can't it.
I don't know... you're still describing a talking parrot here, if you'd ask me.
I’m not a fan of the talking parrot argument, especially when you’re pointing it at models of scale.
The only thing separating a talking parrot and humans is our accuracy in shaping our words to the context in which they’re spoken.
Sure it’s easy to liken a low resource model to a talking parrot, the output seems no better than selective repetition of training data. But is that really so different from a baby whose first words are mimics from the environment around them?
I would argue that as we learn language we implicitly develop the neural circuitry to continue to improve our lexical outputs, this circuitry being concepts like foresight, reasoning, emotion, logic, etc and that while we can take explicit action to teach these ideas, they naturally develop in isolation as well.
I don’t think language models, especially at scale, are much different. They would seem to similarly acquire implicit circuitry like we do as they are exposed to more data. As I see it, the main difference in what exactly that circuitry accomplishes and looks like in final output has more to do with the limited styles of data we can provide and the limitations of fine tuning we can apply on top.
Humans would seem to share a lot in common with talking parrots, we just have a lot more capable hardware to select what we repeat.
What if we were talking with each other and the right answer for me would be to kiss you on the cheek? Then what?
What's the difference between a human and a talking parrot that can answer any question you ask it?
The talking parrot can only answer by repeating something it heard before.
Another question you could ask is “What’s the difference between a conversation between 2 people and a conversation between 2 parrots who can answer any question?”
It doesn't only repeat things it's heard before. Have you ever talked with an LLM?
I had ChatGPT design a programming language for a specific uncommon purpose and then use it. It's creative enough.
Can any question be answered? As long as any reaction on a question is considered an answer, then I see no difference between a human and a parrot.
I feel the use of the word "parrot" is unintentionally apt, given that parrots were long thought to be mere mimics but were ultimately shown to have (at least the capacity for) real linguistic understanding.