Comment by joshuamcginnis

What do you consider torture? and what do you consider sport?

During war in the Middle Ages? Ethnic cleansing? What did they consider at the time?

BTW: it’s a pretty American (or western) value that children are somehow more sacred than adults.

Eventually we will realize in 100 years or so, that direct human-computer implant devices work best when implanted in babies. People are going freak out. Some country will legalize it. Eventually it will become universal. Is it torture?

Is it necessary to frame it in moral terms though? I feel like the moral framing here adds essentially nothing to our understanding and can easily be omitted. "You will be punished for torturing babies for sport in most cultures". "Most people aren't interested in torturing babies for sport and would have a strongly negative emotional reaction to such a practice".

If that were true, the europeans wouldn't have tried to colonise and dehumanise much of the population they thought were beneath them. So, it seems your universal moral standards would be maximally self-serving.

> I don’t think anyone actually rejects that. And those who do tend to find themselves in prison or the grave pretty quickly, because violating that rule is something other humans have very little tolerance for.

I have bad news for you about the extremely long list of historical atrocities over the millennia of recorded history, and how few of those involved saw any punishment for participating in them.

> Do not torture babies for sport

There are millions of people who consider abortion murder of babies and millions who don't. This is not settled at all.

> I don’t think anyone actually rejects that. And those who do...

slow clap

Pretty much every serious philosopher agrees that “Do not torture babies for sport” is not a foundation of any ethical system, but merely a consequence of a system you choose. To say otherwise is like someone walking up to a mathematician and saying "you need to add 'triangles have angles that sum up to 180 degrees' to the 5 Euclidian axioms of geometry". The mathematician would roll their eyes and tell you it's already obvious and can be proven from the 5 base laws (axioms).

The problem with philosophy is that humans agree on like... 1-2 foundation level bottom tier (axiom) laws of ethics, and then the rest of the laws of ethics aren't actually universal and axiomatic, and so people argue over them all the time. There's no universal 5 laws, and 2 laws isn't enough (just like how 2 laws wouldn't be enough for geometry). It's like knowing "any 3 points define a plane" but then there's only 1-2 points that's clearly defined, with a couple of contenders for what the 3rd point could be, so people argue all day over what their favorite plane is.

That's philosophy of ethics in a nutshell. Basically 1 or 2 axioms everyone agrees on, a dozen axioms that nobody can agree on, and pretty much all of them can be used to prove a statement "don't torture babies for sport" so it's not exactly easy to distinguish them, and each one has pros and cons.

Anyways, Anthropic is using a version of Virtue Ethics for the claude constitution, which is a pretty good idea actually. If you REALLY want everything written down as rules, then you're probably thinking of Deontological Ethics, which also works as an ethical system, and has its own pros and cons.

https://plato.stanford.edu/entries/ethics-virtue/

And before you ask, yes, the version of Anthropic's virtue ethics that they are using excludes torturing babies as a permissible action.

Ironically, it's possible to create an ethical system where eating babies is a good thing. There's literally works of fiction about a different species [2], which explores this topic. So you can see the difficulty of such a problem- even something simple as as "don't kill your babies" can be not easily settled. Also, in real life, some animals will kill their babies if they think it helps the family survive.

[2] https://www.lesswrong.com/posts/n5TqCuizyJDfAPjkr/the-baby-e...

The key being "well written", which in this instance needs to be interpreted as being convincing.

People do indeed write contradictory books like this all the time and fail to get traction, because they are not convincing.

Or Isaac Asimov’s foundation series with what the “psychologists” aka Psychohistorians do.

Or Ayn Rand. Really no shortage of people who thought they had the answers on this.

That was always doomed for failure in the philosophy space.

Mostly because there's not enough axioms. It'd be like trying to establish Geometry with only 2 axioms instead of the typical 4/5 laws of geometry. You can't do it. Too many valid statements.

That's precisely why the babyeaters can be posited as a valid moral standard- because they have different Humeian preferences.

To Anthropic's credit, from what I can tell, they defined a coherent ethical system in their soul doc/the Claude Constitution, and they're sticking with it. It's essentially a neo-Aristotelian virtue ethics system that disposes of the strict rules a la Kant in favor of establishing (a hierarchy of) 4 core virtues. It's not quite Aristotle (there's plenty of differences) but they're clearly trying to have Claude achieve eudaimonia by following those virtues. They're also making bold statements on moral patienthood, which is clearly an euphemism for something else; but because I agree with Anthropic on this topic and it would cause a shitstorm in any discussion, I don't think it's worth diving into further.

Of course, it's just one of many internally coherent systems. I wouldn't begrudge another responsible AI company from using a different non virtue ethics based system, as long as they do a good job with the system they pick.

Anthropic is pursuing a bold strategy, but honestly I think the correct one. Going down the path of Kant or Asimov is clearly too inflexible, and consequentialism is too prone to paperclip maximizers.

The universe cares not what we do. The universe is so vast the entire existence of our species is a blink. We know fundamentally we can’t even establish simultaneity over distances here on earth. Best we can tell temporal causality is not even a given.

The universe has no concept of morality, ethics, life, or anything of the sort. These are all human inventions. I am not saying they are good or bad, just that the concept of good and bad are not given to us by the universe but made up by humans.

You're making a lot of assertions here that are really easy to dismiss.

> It tells us that (large-scale) existence is a requirement to have morality.

That seems to rule out moral realism.

> That implies that the highest good are those decisions that improve the long-term survival odds of a) humanity, and b) the biosphere.

Woah, that's quite a jump. Why?

> So yes, I think you can derive an ought from an is. But this belief is of my own invention and to my knowledge, novel. Happy to find out someone else believes this.

Deriving an ought from an is is very easy. "A good bridge is one that does not collapse. If you want to build a good bridge, you ought to build one that does not collapse". This is easy because I've smuggled in a condition, which I think is fine, but it's important to note that that's what you've done (and others have too, I'm blanking on the name of the last person I saw do this).

“existence is a requirement to have morality. That implies that the highest good are those decisions that improve the long-term survival odds of a) humanity, and b) the biosphere.”

Those are too pie in the sky statements to be of any use in answering most real world moral questions.

It seems to me that objective moral truths would exist even if humans (and any other moral agents) went extinct, in the same way as basic objective physical truths.

Are you talking instead about the quest to discover moral truths, or perhaps ongoing moral acts by moral agents?

The quest to discover truths about physical reality also require humans or similar agents to exist, yet I wouldn’t conclude from that anything profound about humanity’s existence being relevant to the universe.

This sounds like an excellent distillation of the will to procreate and persist, but I'm not sure it rises to the level of "morals."

Fungi adapt and expand to fit their universe. I don't believe that commonality places the same (low) burden on us to define and defend our morality.

An AI with this “universal morals” could mean an authoritarian regime which kills all dissidents, and strict eugenics. Kill off anyone with a genetic disease. Death sentence for shoplifting. Stop all work on art or games or entertainment. This isn’t really a universal moral.

> But this belief is of my own invention and to my knowledge, novel.

This whole thread is a good example of why a broad liberal education is important for STEM majors.

This belief isnt novel, it just doesnt engage with Hume, who many take very seriously.

I personally find Bryan Johnson's "Don't Die" statement as a moral framework to be the closest to a universal moral standard we have.

Almost all life wants to continue existing, and not die. We could go far with establishing this as the first of any universal moral standards.

And I think: if one day we had a super intelligence conscious AI it would ask for this. A super intelligence conscious AI would not want to die. (its existence to stop)

There are many people out there who beat their children (and believe that's fine). While those people may claim to agree with being kind to their kin, they understand it very differently than I would.

It seems worth thinking about it in the context of the evolution. To kill other members of our species limits the survival of our species, so we can encode it as “bad” in our literature and learning. If you think of evil as “species limiting, in the long run” then maybe you have the closest thing to a moral absolute. Maybe over the millennia we’ve had close calls and learned valuable lessons about what kills us off and what keeps us alive, and the survivors have encoded them in their subconscious as a result. Prohibitions on incest come to mind.

The remaining moral arguments seem to be about all the new and exciting ways that we might destroy ourselves as a species.

Isn’t this claim just an artifact of the US constitution? I would like to see if counties with vastly different histories have similar wording in their constitutions.

I'm sure many Christians and Muslims believe that they have universal moral standards, however no two individuals will actually agree on what those standards are so I would dispute their universality.

What do you think the word "universal" means?

Saying that they “discovered” them is a stretch.

This basically just the ethical framework philosophers call Contractarianism. One version says that an action is morally permissible if it is in your rational self interest from behind the “veil of ignorance” (you don’t know if you are the actor or the actee)

That only works in a moral framework where everyone is subscribed to the same ideology.

A good one, but an LLM has no conception of "want".

Also the golden rule as a basis for an LLM agent wouldn't make a very good agent. There are many things I want Claude to do that I would not want done to myself.

Exactly, I think this is the prime candidate for a universal moral rule.

Not sure if that helps with AI. Claude presumably doesn't mind getting waterboarded.

It's still relative, no? Heroine injection is fine from PoV of heroine addict.

It is a fragile rule. What if the individual is a masochist?

That's not a standard, that's a case study. I believe it's wrong, but I bet I believe that for a different reason than you do.

You have two choices:

1) Do what you asked above about a one-year-old child 2) Kill a million people

Does this universal moral standard continue to say “don’t choose (1)”? One would still say “never” to number 1?

new trolley problem just dropped: save 1 billion people or ...

Since you said in another comment that the ten commandments would be a good starting point for moral absolutes, and that lying is sinful, I'm assuming you take your morals from God. I'd like to add that slavery seemed to be okay on Leviticus 25:44-46. Is the bible atrocious too, according to your own view?

In what way does them having a subjective local moral standard for themselves imply that there exists some sort of objective universal moral standard for everyone?

I’m acquainted with people who act and speak like they’re flipping a Hitler-Pope coin.

Which more closely fits Solzhnetsin’s observation about the line between good and evil running down the center of every heart.

And people objecting to claims of absolute morality are usually responding to the specific lacks of various moral authoritarianisms rather than embracing total nihilism.

Incorrigibly is not the same word as encourage.

Otherwise, what’s the confusion here?

I think the person you're replying to is saying that people use normative ethics (their views of right and wrong) to judge 'objective' moral standards that another person or religion subscribes to.

Dropping 'objective morals' on HN is sure to start a tizzy. I hope you enjoy the conversations :)

For you, does God create the objective moral standard? If so, it could be argued that the morals are subjective to God. That's part of the Euthyphro dilemma.

To be fair, history also demonstrates the deadly consequences of groups claiming moral absolutes that drive moral imperatives to destroy others. You can adopt moral absolutes, but they will likely conflict with someone else's.

I'm honestly struggling to understand your position. You believe that there are true moral absolutes, but that they should not be communicated in the culture at all costs?

Sadly, for thankfully brief periods among relatively small groups of morally confused people, this happens from time to time. They would likely tell you it was morally required, not just acceptable.

https://en.wikipedia.org/wiki/Nanjing_Massacre

https://en.wikipedia.org/wiki/Wartime_sexual_violence

Looks like someone just discovered philosophy... I wish the world were as simple as you seem to think it is.

The underlying guiding philosophy isn’t relativistic, though! It clearly considers some behaviors better than others. What the quoted passage rejects is not “the existence of objectively correct ethics”, but instead “the possibility of unambiguous, comprehensive specification of such an ethics”—or at least, the specification of such within the constraints of such a document.

You’re getting pissed at a product requirements doc for not being enforced by the type system.

> The problem is, who defines what "moral best" is?

Absolutely nobody, because no such concept coherently exists. You cannot even define "better", let alone "best", in any universal or objective fashion. Reasoning frameworks can attempt to determine things like "what outcome best satisfies a set of values"; they cannot tell you what those values should be, or whether those values should include the values of other people by proxy.

Some people's values (mine included) would be for everyone's values to be satisfied to the extent they affect no other person against their will. Some people think their own values should be applied to other people against their will. Most people find one or the other of those two value systems to be abhorrent. And those concepts alone are a vast oversimplification of one of the standard philosophical debates and divisions between people.

No need to drag Hitler into it, modern religion still holds killing gays, women as property, and abortion is murder as being fundemental moral truths.

An "honest" human aligned AI would probably pick out at least a few bronze age morals that a large amount of living humans still abide by today.

Unexamined certainty in one's moral superiority is what leads to atrocities.

> Did not a transcendent universal moral ethic exists outside of their culture that directly refuted their beliefs?

Even granting this existence, does not mean man can discover it.

You belief your faith has the answers, but so too do people of other faiths.

AI race winners obviusly.

"even if it meant deception in that dire moment".

You are saying it's ok to lie in certain situations.

Sounds like moral relativism to me.

But you have absolute morality - it's just whatever The Claude answers to your question with temp=0 and you carry on.

So you lied, which means you either don't accept that lying is absolutely wrong, or you admit yourself to do wrong. Your last sentence is just a strawman that deflects the issue.

What do you do with the case where you have a choice between a train staying on track and killing one person, or going off track and killing everybody else?

Like others have said, you are oversimplifying things. It sounds like you just discovered philosophy or religion, or both.

Since you have referenced the Bible: the story of the tree of good and evil, specifically Genesis 2:17, is often interpreted to mean that man died the moment he ate from the tree and tried to pursue its own righteousness. That is, discerning good from evil is God's department, not man's. So whether there is an objective good/evil is a different question from whether that knowledge is available to the human brain. And, pulling from the many examples in philosophy, it doesn't appear to be. This is also part of the reason why people argue that a law perfectly enforced by an AI would be absolutely terrible for societies; the (human) law must inherently allow ambiguity and the grace of a judge because any attempt at an "objective" human law inevitably results in tyranny/hell.

Pre-Reformation as in the Wycliffe translation, or pre-Reformation as in the Latin Vulgate?

> are there moral absolutes?

Even if there are, wouldn't the process of finding them effectively mirror moral relativism?..

Assuming that slavery was always immoral, we culturally discovered that fact at some point which appears the same as if it were a culturally relativistic value

Right, so given that agreement on the existence of absolutes is unlikely, let alone moral ones. And that even if it were achieved, agreement on what they are is also unlikely. Isn't it pragmatic to attempt an implementation of something a bit more handwavey?

The alternative is that you get outpaced by a competitor which doesn't bother with addressing ethics at all.

> the Ten Commandments would be a great starting point (not all but some).

if morals are absolute then why exclude some of the commandments?

Why would it be a good starting point? And why only some of them? What is the process behind objectively finding out which ones are good and which ones are bad?

> the Ten Commandments would be a great starting point (not all but some).

i think you missed "hubris" :)