Comment by justonceokay

7 days ago

I’ll bite the bullet: if a robot has a complicated enough internal representation of the world, it may very well develop a concept of love (or “care”, or “noticing”, or “intention”. Love is such a slippery word…) that we would have to trust.

Imagine a cat-sitting robot. The robot can differentiate between individual cats. It learns how to play with the cats and feed them in in their preferred way. The cats grow to trust the robot and enjoy its company. When the cats become sick and old the robot knows how to help them and ease their pain. Over decades The robot remembers cats in its care that have died, and new cats spark recognition of previous cats it has known. It becomes better at caring for a wider range of cats as its experience grows. The cats cry out when it leaves. When there are no cats around the robot remains motionless, but springs into action and play as soon as cats are around. Children would describe the robot as “happy”.

If after some decades I smash it with a hammer and recycle the pieces, am I killing something? Are its internal representations and control systems not a kind of thing that produces “qualia”?

This - as usual - confuses behaviour with consciousness.

Humans bonded with ELIZA, but that didn't mean ELIZA was conscious. ELIZA was an automaton that mimicked certain behaviours that triggered certain emotional responses.

If you scale that up you get an LLM and/or a social media bot farm, both of which are much better at triggering responses than ELIZA was.

It's now trivial to create an automaton that play acts various moods, and if you give it a memory it will mimic relationship-related conversations.

But it doesn't need to be conscious to do that, and the parsimonious Occam's razor explanation of its behaviours is that it's more economic and credible to assume it's still an automaton with no self-awareness.

Otherwise you have to argue that much simpler systems, like PID thermostats, and pretty much every computer system, are conscious because they "experience" qualia that represent a varying state of the world, with memory.

The sneakiness in your example is choosing an example which mimics emotional bonding. Rhetorically that makes it look like a hypothetical robot is acting emotionally, which is one of the covert signals us mammals tend to associate with consciousness.

But the criticism stands. Feigning emotions well enough to fool other mammals isn't at all the same as experiencing them.

To really experience emotions you need a self-image quale which includes an emotional component. And since subjective experiences have no objective element that can be measured, we can never say for sure whether anything or anyone else actually is conscious.

We assume we are, because we experience it, and we assume others are by implication.

But there's a point where that assumption stops being reasonable, and that's where your cat robot exists.

  • I guess where I am coming from with my cat robot is that I believe behavior begets consciousness. Whatever behavior is happening, that must mean some internal representation of the world is driving it. Robots will never have human emotions but I believe that some robots /already/ have their own goals and internal representations of reality and models of themselves worth considering on their own terms. A roomba must know where it is in space. Just because it doesn’t feel ennui as well is hardly a shortcoming.

    Our brains are very complicated models of the world that attempt to mirror reality. That is what it means to be able to navigate physical space and provide for ourselves in nature. Our nature includes an incredibly complex social sphere and we have emotions to help us better navigate it. Animals we domesticate are clued into human emotions, others are not. I bet slugs have less of a sense of “I” but they still have some kind of an experience. I bet a tree has even less. It’s a sliding scale—each organism has just enough awareness for the task at hand.

    The fact that we have a large emotional catalogue and a (some could say overly developed) sense of self is a curiosity more than a hard problem. It’s “I am a strange loop”, not “I am an ineffable indescribable inscrutable untouchable loop”.

> if a robot has a complicated enough internal representation of the world, it may very well develop a concept of love

There are two concepts of "may" at play here:

"may" in the sense of "nothing keeps us from imagining this", and in the sense of "we know how it works, and it can happen".

A car may crash, and glass may break are the latter.

But for the former we actually have no idea how this could work. That is what makes it a hard philosophical problem. That kind of "may" is cheap.

How does the robot work? Sound like there's some knowledge accumulated in there, and you'd be being destructive, like burning books, but the robot doesn't create ideas. Qualia, I couldn't comment on. Well, it seems the term refers to private ideas that can't be communicated. So, no.

  • at the risk of jumping the shark into full-on “woo woo”: what does it mean to “create ideas”? are ideas created or revealed? if ideas are created where do they come from? if ideas are revealed, then does that necessarily imply a determinism? if the robot devises a novel solution to a technical problem, isn’t that an idea? or is the robot’s solution actually the unavoidable result of the entire history of analytical thought? if the novel solution isn’t the creation of an idea, then what makes an idea an idea? if Michelangelo’s David was sculpted by an automaton, is it less beautiful? If so, why? If not, why not?

no you didn’t kill it, it was never alive. the same way my dishwasher or vacuum aren’t killed when they break and i replace them. even if the robot “remembers”, who cares? when i bin my phone did i kill siri because she sometimes remembered things for me?

nicely done and well put. one of the better intros to the “hard problem” i’ve read, truly

  • Thanks. It’s mostly a distillation of thoughts I have had from reading the various spats through the years between Chalmers and Dennett. I think Dennett is much more convincing to me.

    My personal take: it’s easy to imagine a robot that has a single sense, like a thermostat. As humans we don’t have a single sense, we may have millions of senses. But I bet that none of those individual systems is much more complicated than the thermostat. Consciousness is not truly differentiable from a complicated response to a complicated environment, and all things in this definition have consciousness to a degree. Even a rock “remembers” through how it has been weathered. We are not special, we are just very complicated.