Comment by roywiggins

Maybe, but it's a bit like taking the output of a Magic 8-ball as evidence for panpsychism. "Maybe all matter is conscious! What do you think, Magic 8-ball?" "Signs point to yes"

that is, if you train an LLM on a bunch of text that is almost certainly going to include stuff about sentient robots, that it sometimes announces that it's a sentient robot is not evidence that it is one