Comment by Sonnigeszeug
3 days ago
I'm arguing that this is to simple of an explanation.
The claude paper showed, that it has some internal model when answering in different languages.
The process of learning can have effects in it, which is more than statistics. IF the training itself optimizes itself by having a internal model representation, than its no longer just statistics.
It also sounds like that humans are the origin of intelligence, but if humans do the same thing as LLM, and the only difference is, that we do not train LLMs from scratch (letting them discover the world, letting them inventing languages etc. but priming them with our world), than our intelligence was emergent and the LLMs one by proxy.
Since the rise of LLMs, the thought has definitely occurred to me that perhaps our intelligence might also arise from language processing. It might be.
The big difference between us and LLMs, however, is that we grow up in the real world, where some things really are true, and others really are false, and where truths are really useful to convey information, and falsehoods usually aren't (except truths reported to others may be inconvenient and unwelcome, so we learn to recognize that and learn to lie). LLMs, however, know only text. Immense amounts of text, without any way to test or experience whether it's actually true or false, without any access to a real world to relate it to.
It's entirely possible that the only way to produce really human-level intelligent AI with a concept of truth, is to train them while having them grow up in the real world in a robot body over a period of 20 years. And that would really restrict the scalability of AI.
I just realized that kids (and adults) these days grow up more in virtual environments behind screens than in touch with the real world, and maybe that might have an impact on our ability to discern truth from lies. That would certainly explain a lot about the state of our world.
A few years back i saw a documentary about kids in a third world country were it is normal to use plastic bags for drinking soda.
These kids couldn't understand that the plastic garbage in their own nature is not part of nature.
Nonetheless, depending on what rules you mean, there are a lot of people who show that logic or 'truth' is not the same for everyone.
People believing in a god, ghosts, conspiricy theories, flat earth etc.
I'm more curious if the 'self' can only be trained if you have a clear line of control. We learn what the self is because there is a part which we can control and than there is a part which we can't control.