← Back to context

Comment by bayindirh

18 hours ago

Oh, no. When you add thermal sensing and offsetting ambient temperature, you can add all kind of "seemingly" intelligent features like feeling the emotions of the bread, and creating the perfect toast without hurting the cute little bread slices, making them perfectly blonde while not showing cruelty to them.

They can even adapt to their environment and the characteristics of the bread even with simplest of mechanisms because the text will be overglossing the fact that different types of breads have different thermal characteristics and this will deeply affect the behavior of the metal strips, bordering near a sentient being even more thoughtful and considerate than a human which is rushing through house to catch the bus in the morning.

>Oh, no. When you add thermal sensing and offsetting ambient temperature, you can add all kind of "seemingly" intelligent features like feeling the emotions of the bread, and creating the perfect toast without hurting the cute little bread slices, making them perfectly blonde while not showing cruelty to them.

Yeah, that's called "stretching it beyond any recognition".

You could do that. It will have none of the effectiveness or resonance of the two stories.

Who have you ever heard make a sincere, good faith argument that a toaster is conscious? Who do you imagine would argue against you if you asserted they were mere automata?

If you can't identify anyone, then this analogy doesn't work.

  • > Who have you ever heard make a sincere, good faith argument that a toaster is conscious?

    More than one, for many classes of devices, incl. toasters. Some were drunk, some were insane, and some were delusional.

    LLMs are no different. They are automata, yet delusional people bring out pitchforks and torches when someone points out that they are just statistical models, and they don't even work when there's no input to them.

    Which is very different than consciousness.

    • Their being statistical models and their being conscious are not contradictory unless proven otherwise. That's not knowledge, it is assumption.

      It would appear to me you have no interest in a real, good faith discussion on this topic because you think anyone who disagrees with you is necessarily delusional. Which is a shame, and that's the kind of dogma you are criticizing.

      This was exactly the point of the story, it's too uncomfortable to admit that we don't know what consciousness is and what is and isn't conscious, so we just brush it under the rug.

      6 replies →

    • > they don't even work when there's no input to them.

      Why is that needed for consciousness? They're artificial. If we put someone in a coma, they don't talk, they're not really conscious. Just because the AI model has a more obvious off switch shouldn't make a difference. It's easy to imagine gluing a cron job to the model so it works randomly. If that doesn't count because it's external, if we take a brain out of a human's head and slap it on the table, it's not going to do anything. If I take the AI's model file and stick it on a USB flash drive, it doesn't do anything. Without a computer to run it on, it doesn't do anything, just like a human brain doesn't do anything without the rest of the human body as the harness.

      The underlying question is, since we created LLMs, we can see into the actual matrix math, the linear algebra that comprises them. So it's easy to dismiss them as a next word guesser. How could consciousness arise from guessing the next word? But we don't know where consciousness comes from in the first place!

      So since we don't know, the fact that, yes, the anthropomorphically named LLM "neurons" are merely matrixes of numbers and we do linear algebra on them; yes, that gives us much more insight as to what it's doing internally compared to a human or any other lifeform with consciousness's brain. And yes, human neurons are much more complicated than a mere 2d matrix of numbers, so far as we know. But we don't know!

      The indightment of LLMs is that they can't say they don't know, and would prefer, instead, to hallucinate and bullshit an answer instead. They can't help it, they learned from the best. As a human though, I don't know if they're conscious, and what I'm going to say about that.