Comment by nomel
5 hours ago
> LLMs in the end have to operate in natural language concepts and the complexity of natural language is bounded by limits of human cognition.
I don't think this is true.
They have to express themselves as tokens. The meaning of those tokens doesn't have to be text. See any model that can handle images/video. Also, I don't think math, svg, etc, are "natural" language.
And, only the final expression is tokens. The intermediate layers, with the encoded concepts, aren't "natural language".
But, to address your concern (which nobody can disagree with, since even humans can't fully express through text/pictures), potentially: https://news.ycombinator.com/item?id=49758615
Yeah, as I understand it, natural language is tokenised and vectorised, and then maths takes ahold.
The model isn't limited to concepts that can be expressed in natural language.
It's only once the AI gets to the output layers that natural language comes back into play.
After all, they're all made out of weights[0].
0: https://maxleiter.com/blog/weights
Reality cannot be reduced to tokens
Can it be reduced to ion concentrations? Because that's how we perceive it. A useful perception is all that really matters.
Thoughts are a poor reflection of reality to begin with.