Comment by hammyhavoc
3 years ago
It's doing what LLMs do. Next word prediction. It didn't "make it up", it incorrectly predicted the relationship of words.
It isn't reasoning about the solution to a problem either, it's running as expected in relating words to each other, that doesn't mean it has any form of understanding of the words or even what it's rendering as an output.
It does just predict the next word, yes, but it turns out that predicting the next word is a complex problem that involves solving many types of subproblems that involve relatively complex reasoning, or at least something that looks very, very much like reasoning
Is it any more reasoning than Bayes' theorem is reasoning? It's statistics and derived probability from said statistics.
> Bayesian inference is a method of statistical inference in which Bayes' theorem is used to update the probability for a hypothesis as more evidence or information becomes available.
That is very clearly reasoning
8 replies →