Comment by spwa4
18 hours ago
> 1) If an LLM says, "I don't know" its underlying data said it as well.
Nope. Emergent behavior exists and at this point dominates LLM behavior. Most of the stuff LLMs say they never learned (they are, always, imitating many different sources at the same time)
... which imho is exactly what humans do.
> Emergent behavior exists and at this point dominates LLM behavior.
Better to say emergent behavior exists and at this point dominates gulled LLM users' behavior.
LLM output is not emergent behaviour. Its simply word prediction with some randomness.
> Its simply word prediction with some randomness.
Word prediction with some randomness can lead to emergent behavior, depending on the specifics (complexity and scale) of the used prediction logic.
I've seen no example of emergent behaviour dominatimg LLM output.
No, it would have been better to say "I don't know"
> LLM output is not emergent behaviour. Its simply word prediction with some randomness.
And this very claim is "simply" the result of a neurotranmitter-moderated Natrium - Potassium ion cascade across a semipermeable membrane.