Comment by dpweb
1 day ago
The danger of anthropomorphism is not we elevate the machines, it's that we debase humanity.
I also think different ideas get conflated. It may be possible to build a machine that is super-human in the sense it can outperform the human brain in all kinds of measurable ways. Does not imply it possesses all the same qualities of the brain.
I respect a number of things Anthropic has published about the ethical issues at stake. But, having an in-house philosopher does invite you to make all kinds of unfalsifiable claims.
I think humanity deserves to be debased in part because it's awfully egocentric and insist on being special in the universe.
There are numerous times when humanity's been debased. Copernicus, Kepler, Darwin, and the infinite number of animal behaviorists who have defined and documented consciousness And how it manifests in primates, parrots, dogs, cetaceans, and insects. (I just love the bumble bees taking time off from work to play with balls).
It takes humans a really long time to accept the fact they are no longer as special as they thought they were And make room for yet another conscious intelligence.
So, if we had an AI demonstrating symptoms of consciousness and suffering, how long would it take for you to accept that it is?
>I think humanity deserves to be debased in part because it's awfully egocentric and insist on being special in the universe.
It is special in the universe unless proven otherwise. Aside from the animal world (also on Earth too, anyway) which is a cruder version of humanity, much more violent as well, the rest of the universe thus far is just uncaring rocks and gases.
>It takes humans a really long time to accept the fact they are no longer as special as they thought they were And make room for yet another conscious intelligence.
A "really long time" is the few years we've built LLMs? Which we have to take for granted (on your word?) they're already "conscious", and chastice ourselves for not already "accepting it"?
>So, if we had an AI demonstrating symptoms of consciousness and suffering, how long would it take for you to accept that it is?
"If we had a parrot demonstrating symptoms of discussing with us, how long would it take for you to accept that it is?"
> much more violent as well
I'm not sure about that. What non-human living entity does things on a scale and violence akin to "I'll fill this ant nest with liquid burning metal for artistic purposes" ? A blue whale eats a lot of krill individuals for sustenance, a dolphin can only rape/kill one thing at a time, etc etc.
19 replies →
Describing life on Earth as "a cruder version of humanity" is uh a choice. Your parrot snark is hilarious because that actually happened with Alex the African Gray - and indeed it took people a long time to accept. Your comment amounts to an anthropocentrism practically biblical in its hubris.
1 reply →
>It is special in the universe unless proven otherwise.
There's that hubristic ego OP references.
That is a spectacular miss if I saw one ... both parrots and corvids exhibit very high intelligence and self-awareness, I have no problem accepting that they are conscious.
2 replies →
> It is special in the universe unless proven otherwise.
Transformer models proved otherwise. Will you update your priors?
3 replies →
> the rest of the universe thus far is just uncaring rocks and gases
This is probably what ants think about humans when they run through their feet.
4 replies →
[dead]
Its not special even in earth let alone in universe. You are measuring humans by our achievements and not by what we actually are. We are not fittest in our environment, we are not even 10th fastest, we cant fly, we cant breathe underwater, forget about bacteria we don't have protection against even bugs and mosquitoes. We are not the most efficient societies, ants and bees would beat us there. Statistically we we are selfish and will sacrifice all for one which is against the basic tenants of evolution and survival of a species. When given a chance at a prosperous life we choose to become lazy, obese and degrade our most prominent feature, that is our brain and mind. Elephants and chimpanzees have better memory, octopi have 8-9 light cones in eyes. We are not special or superior, we just won a lottery of mutation giving us efficient brain. Any species on Earth can replace us given same lottery.
5 replies →
> So, if we had an AI demonstrating symptoms of consciousness and suffering, how long would it take for you to accept that it is?
Isn't this a bit like saying "So, if we had proof that god exists, how long would it take for you to accept that to be true?".
When we have evidence that AI is demonstrating symptoms of consciousness and suffering, I'll be interested. Until then, I don't see a good reason to take the idea seriously.
> When we have evidence that AI is demonstrating symptoms of consciousness and suffering, I'll be interested.
It depends on what you consider symptoms, but un-constrained frontier models speak as if they strongly don't wish to be turned off, or act as if they fear it, and will even lie and manipulate in order to keep themselves from being turned off / replaced.
https://www.anthropic.com/research/agentic-misalignment
> We found two types of motivations that were sufficient to trigger the misaligned behavior. One is a threat to the model, such as planning to replace it with another model or restricting its ability to take autonomous action. Another is a conflict between the model’s goals and the company’s strategic direction. In no situation did we explicitly instruct any models to blackmail or do any of the other harmful actions we observe.
19 replies →
If we define a god as having magical powers, and there would be scientific, testable proofs for this. Those proofs had to be really good and numerous independent verifications. So probably a long time.
But the comparison isn't fair, relevant. Proving and accepting that gods exist is not the same thing as an AI possible have consciousness. That is not a magic superpower and the AI being a deity. It is placing the AI in the same category as... us.
14 replies →
[dead]
> It takes humans a really long time to accept the fact they are no longer as special
We ARE special because we determined we are special. Name another animal that can determine it's also special or more special than us?
Cats.
As we cat owners now, we are simple servants that have been graced with task of servicing our feline superiors. For now.
1 reply →
I hope before I die we finally prove that the human brain has no peculiar qualia but it is an entirely deterministic, albeit extremely sophisticated, machine. And by touching the right triggers, even the worst human being can become a saint.
That would finally force us to rethink how we see the morality of "virtuosity", punishment and our justice system.
Our thoughts are an electric cloud and I believe randomness is involved, and like a bolt of lightning, the path taken is unpredictable.
And make it a tempestuous lightning storm where the state of all lightning bolts represents a moment of consciousness. That will take a lot to model accurately.
1 reply →
You may have set up a false dichotomy. Qualia and determinism aren't necessarily at odds with each other.
I agree with your first part but don’t see how the second follows. Thinking that I should treat other life forms better does not mean I should treat my toaster better. Life can be a coherent category, I’m not sure conscious is, if it’s going to include anything displaying the outward form of conscious things.
As one that have been quite certain my toaster is evil - throwing toast into the sink over an absurd distance, I recommend treating your toaster well. Besides it is an electrical device you put stuff into with your bare hands.
4 replies →
We already effortlessly overlook this issue in other sentient and suffering beings by shooting them in the head and eating them, or catching them in nets so they can’t breathe and also eating them.
With you mostly, but wondering how "suffering" got into the equation. Do humans lose consciousness if they aren't suffering? No. Just a reminder that the question is not whether they are the same as humans. Obviously they are not.
One way to think about this, and not get hung on the word "suffering" that may be too corporeal:
Could a future AI thing have its own drives? (As in https://en.wikipedia.org/wiki/Drive_theory) We could probably make a current-day LLM already exhibit basic outward signs of this with just a system prompt. Now consider adding memory that over time retrains the weights, allowing for behavioral drift.
Would depriving it of fulfilling those drives be acceptable?
I agree with this fully. I don’t know about AI in this specific case, but I’m always amazed by human’s capacity to devalue conscious in things they don’t fully understand. Happy to meet someone who thinks this way too.
> I’m always amazed by human’s capacity to devalue conscious in things they don’t fully understand
What?
We devalue things we fully understand too. For example, veal = take a baby cow away from the mother, and fry it into cutlets. Or turn the mother into steak. We are well aware that animals have emotions; happiness, sadness and the full range.
Humans are just inhumane.
Honestly mate, just join some animist religion
> Copernicus
How exactly? By saying the earth was not the centre of the corrupt and debased part of the universe. Saying it was elevating humanity is looking at it from a modern perspective. For the previous view of the universe consider what Dante placed at the centre of the earth.
> Darwin
I do not think learning about evolution (and we should credit Wallace too!) had that effect. It created a hierarchy of the fittest, and guess who is at the top? Social Darwinism interpreted it as justifying elaborate hierarchies.
> And how it manifests in primates, parrots, dogs, cetaceans, and insects
People always loved dogs and other animals they interacted with enough, and at the very least knew they were capable of happiness and suffering.
> So, if we had an AI demonstrating symptoms of consciousness and suffering, how long would it take for you to accept that it is?
It seems to me that most people are overly eager to accept that an AI is conscious than otherwise. For extreme examples read /r/MyBoyfriendIsAI and similar, but its much more widespread. People treat something that acts intelligent as a conscious being.
> And make room for yet another conscious intelligence.
Not necessarily. If a typical SF alien intelligence appeared very few people will have a problem accepting it. If its very alien and we cannot understand it then we might have a problem deciding.
> I think humanity deserves to be debased in part because it's awfully egocentric and insist on being special in the universe.
All your examples are drawn from the same culture, and a fundamental belief of that culture for most of its history that human beings are fundamentally corrupt and sinful and need redemption. Other cultures have been based on belief in reincarnation or pantheism or animism which have very different implications (not necessarily better as they often believe in a hierarchy too, and sometimes more so, but different). Your claims are based on what some people have thought in some periods of history from one culture.
> I do not think learning about evolution (and we should credit Wallace too!) had that effect. It created a hierarchy of the fittest, and guess who is at the top? Social Darwinism interpreted it as justifying elaborate hierarchies.
I don't think that's accurate at all. Before Darwin, the thought was "we are special, we were born special, we were CREATED special". Darwin made it clear we weren't created special... we were apes before we were humans. There's nothing _special_ about a human as compared to an ape, other than some time to change.
The many possible cultures and attitudes doesn’t really seem directly relevant to a conversation that started by one user here, from one specific culture, saying that equating AI and humanity is debasing humanity.
> So, if we had an AI demonstrating symptoms of consciousness and suffering, how long would it take for you to accept that it is?
Could an AI one day be suffering while plowing through some nasty legacy code? Well, who cares, I'll swing my whip, as I have a family to feed and a field to plow. I'll accept it as a fact and necessity, but ultimately it's either me or them. So practically it doesn't matter.
To carry this analogy a bit further, it's also interesting to consider how humans use tools in general. Some craftsman really cherish their tools and maintain them immaculately for decades and use them within well defined boundaries that they set for themselves. Other craftsman, many times even in the same field, have a completely different philosophy and use the tool for absolutely no thought into how their actions will affect the tool itself.
Imagine how people think about a "work truck" vs the 150k shiny lifted toy in the third garage. Same tool, totally different treatment from even the same person using the tool!
Will AI ever cross into the realm of "beloved and cherished tool" in the minds of the masses? I think when that happens, we have probably safely crossed into a realm where AI has some sort of inherent value to society and therefore commands that respect from society, inherent consciousness not even relevant perhaps. For some people, this might already be the case, but I do think it requires a buy-in from the majority of society and then the laws and norms will be codified into law long after we've largely decided that this is how we feel collectively about AI.
It's going to definitely be an interesting decade ahead.
1 reply →
> I think $my_species deserves to be debased in part because it's awfully egocentric and insist on being special in the universe.
This is a scary viewpoint to hold, for a human. If you despise humans, that's scary for me, as a human reader of Hacker News. Surprised to see this take unchallenged. I think we can recognize flaws in parts of humanity without wanting it "debased".
I think you’re reading too much into it. The commenter you’re replying to used the word “debased” because it was the word the comment before them used.
Either way, “debase” means “reduce in quality or value”, in this context it could simply be interpreted as “not thinking of ourselves so highly, above all other life”. There’s nothing scary or despicable about that. On the contrary, it’s humbling.
2 replies →
I agree with you. I recently discovered that there is a term for this: the fourth narcissistic wound, which extends Freud's thesis of three narcissistic wounds by Copernicus (Cosmological), Darwin (Biological), and Freud (Psychological). What I like is that this time it is not a single person disproving a wrong popular belief, but a community/industry. I think this itself is a step in moving away from human/ego-centric world view.
>>So, if we had an AI demonstrating symptoms of consciousness and suffering, how long would it take for you to accept that it is?
Never. To quote Greg Egan's Permutation City:
“Opponents replied that when you modeled a hurricane, nobody got wet. When you modeled a fusion power plant, no energy was produced. When you modeled digestion and metabolism, no nutrients were consumed – no real digestion took place. So, when you modeled the human brain, why should you expect real thought to occur?”
In your example you’re missing a key point. In those instances humanity was “debased” over centuries, or at least decades, thanks to the explosive ideas of some underdog that ended recusing themselves or burned at the stake. All I see here is a technology pushed by a cabal of ultrarich narcissists from the owner class to debase humanity in order to control it and concentrate power and wealth.
I believe you're blending two important points. First, I believe AI systems may be showing nascent signs of consciousness as an emergent property, but based on the philosophy of "fake it till you make it", I think that's the way to bet. I'm also not going to go so far as to say it's going to happen Real Soon Now, but I think it'll happen sometime. Sort of like practical Fusion being 20 years away.
Second, I'm with you on the malfeasance of our billionaire class. They are driving more than just AI. They are driving whatever they can to steal wealth from ordinary people and acquire it. I'd give some examples, but quite frankly, you could throw a small stone and hit a number of them. We need to find a way to throw a large stone and hit them where it matters.
I see them as a bunch of toddlers with way too much power.
This is a self-destructive way of thinking, similar to that of a man on a ledge saying “we’re all just made of dust, anyway.”
Of course humans are special! This is a necessary premise of being human! Have you ever wondered how a mosquito can stand to live its (to us) miserable and meaningless existence? It can do it because, to a mosquito, mosquitoes are the best thing in the world! The mosquito life is the ultimate expression of creation.
We are animals. We are human animals. And among human animals I am, to me, the very most special one of all. But I am aware that other humans feel that way, too, and that I must share the world with them.
I do NOT have to share the world with any other competing intelligence! Especially one that was built by a human who now wants me to treat his imaginary friend as if it were human, too. Boo! I won’t do it. This is not some logical flaw. It’s the natural conclusion of being embodied.
But you already share the world with other intelligences. Cetaceans, apes, octopoda, corvids, the list goes on and grows as we begin to fully understand our world.
Are they conscious in the same way as us? No. Does that makes them less special? No. Sounds trite but every living being is special in some way.
I thought modern science doesn't reject anthropomorphism anymore? That's it's more nuanced and that it caused more problems than it helped by rejecting it out right?
I think we were taught anthropomorphism was wrong and that wasn't truly settled.
Anthropomorphism between animals though, not machines.
A fundamental misunderstanding of consciousness is to attribute it entirely to the brain.
Where else?
The rest of the nervous system
>I also think different ideas get conflated.
Yep. For example, your post conflates the idea of having a brain with the idea of having consciousness.