Comment by arc619
3 hours ago
A video is a fixed representation.
What if we can interact with this video, and it reacts in the same ways the source organism does?
Then we put it in new situations that weren't in the source video, and it interacts in a similar way to the original organism in these situations, too.
What do we make of reactions of pain or joy? Where's the line between simulation and enaction?
This is closer to the reality of these models.
I'm not suggesting I know where that line is - if indeed it is a line at all - it could well be a gradient.
LLMs are deterministic, though. Much like the video.
AFAIK using the same input tokens, weights, and numerical operations will lead to the same probability distribution for the next token. It uses pseudo-randomness to enable temperature, etc. Like a fuzzy video.
"Markers that would indicate consciousness if observed in a biological organism" just does not mean very much. A PR phrase used to hype the IPO.
Videos and LLMs are not deterministic in the same sense at all.
LLMs are deterministic in the same sense as biological processes. And a faithful simulation of a brain would have all the properties you note.
No, that is not at all something we can just state as a fact. Whether the brain is deterministic is an open question that just inherits the good old unsolvable determinism debate.
The LLM pseudo-randomness from above is engineered by us and fully understood, much like an algorithm playing a video frame sequence.
You could theoretically record a full register of all states of an LLM setup with all the possible inputs and environment parameters, and it would fully describe everything you would ever get from a given LLM setup. It would be a very large, convoluted book.
I understand that Anthropics PR department wants to see truth or reason behind every "I'm alive" the LLM generates. Even the term "self-report" is anthropomorphizing, as an LLM does not do anything on its own at all. It is just one of the narratives they spin all day, probably at least until the IPO.