Comment by justonceokay

This - as usual - confuses behaviour with consciousness.

Humans bonded with ELIZA, but that didn't mean ELIZA was conscious. ELIZA was an automaton that mimicked certain behaviours that triggered certain emotional responses.

If you scale that up you get an LLM and/or a social media bot farm, both of which are much better at triggering responses than ELIZA was.

It's now trivial to create an automaton that play acts various moods, and if you give it a memory it will mimic relationship-related conversations.

But it doesn't need to be conscious to do that, and the parsimonious Occam's razor explanation of its behaviours is that it's more economic and credible to assume it's still an automaton with no self-awareness.

Otherwise you have to argue that much simpler systems, like PID thermostats, and pretty much every computer system, are conscious because they "experience" qualia that represent a varying state of the world, with memory.

The sneakiness in your example is choosing an example which mimics emotional bonding. Rhetorically that makes it look like a hypothetical robot is acting emotionally, which is one of the covert signals us mammals tend to associate with consciousness.

But the criticism stands. Feigning emotions well enough to fool other mammals isn't at all the same as experiencing them.

To really experience emotions you need a self-image quale which includes an emotional component. And since subjective experiences have no objective element that can be measured, we can never say for sure whether anything or anyone else actually is conscious.

We assume we are, because we experience it, and we assume others are by implication.

But there's a point where that assumption stops being reasonable, and that's where your cat robot exists.

> if a robot has a complicated enough internal representation of the world, it may very well develop a concept of love

There are two concepts of "may" at play here:

"may" in the sense of "nothing keeps us from imagining this", and in the sense of "we know how it works, and it can happen".

A car may crash, and glass may break are the latter.

But for the former we actually have no idea how this could work. That is what makes it a hard philosophical problem. That kind of "may" is cheap.

How does the robot work? Sound like there's some knowledge accumulated in there, and you'd be being destructive, like burning books, but the robot doesn't create ideas. Qualia, I couldn't comment on. Well, it seems the term refers to private ideas that can't be communicated. So, no.

no you didn’t kill it, it was never alive. the same way my dishwasher or vacuum aren’t killed when they break and i replace them. even if the robot “remembers”, who cares? when i bin my phone did i kill siri because she sometimes remembered things for me?

nicely done and well put. one of the better intros to the “hard problem” i’ve read, truly

More than that - I think that people who are grieving may not know how they "should" be grieving. Consider that some cultures (literally) perform grief by - for example - wailing at the grave. Others may wear a particular colour of clothing, etc.

You can say to yourself "I am grieving" but still have the nagging suspicion that you are not doing it 'right' in some sense. Similarly (I think) for many emotions - how happy should I be in this moment? How excited?

On the flip side, there are people who (seemingly) over-dramatize every event - but are they pretending, or do they really feel things that keenly? I suspect that most emotion is some combination of raw/organic emotion, and the more cultural/performative/learned emotional response.

It gets complicated, is what I'm saying.

Is that so trippy? They can also lie about other things. Where they were in 2013, what's in their pockets, whether they've been eating vegetables. You may never feel sure, but you can form a theory from clues eventually.

What are emotions, really? It’s a bit easier than consciousness to research but still many theories exist. A popular one is that emotions always appear because the work(ed) to one’s benefit. They are always meant to manipulate the environment.

With sociopaths, do they simulate, generate, push away, ignore, control, their emotions, more or less than others? Also psychopathy/sociopathy is difficult to research because it’s hard to measure anything; even if you trust what they may be claiming, how do you know how they experience them.

One perspective is that some may not feel emotions because emotions did not successfully manipulate their environment in childhood. So why develop them. If anger worked to manipulate your environment, you may become angry easily later on, in an attempt to replicate the successful manipulation. If grief worked, you will experience grief. If “coldness” worked, you will react coldly. If “empathy” worked to manipulate to your benefit, you will be tuned to try empathy.

“Normal” only shows what typically works in a society, not what is “healthy” or “natural”. We’re all highly adaptive individuals, learning how to survive in whatever environment we grow up in. We all become master manipulators, because that’s how we survive. Some forms of manipulation may be more socially accepted than others, within a given culture, others less so. Sociopathy doesn’t exist outside of a culture’s value system. It is a disorder only once you define what order is. In a society of narcissists, the empath is the sick one.

We really only have our own experience, and the words of others to compare it to.

bingo