Comment by spot
16 hours ago
> This rejects any fixed, universal moral standards
uh did you have a counter proposal? i have a feeling i'm going to prefer claude's approach...
16 hours ago
> This rejects any fixed, universal moral standards
uh did you have a counter proposal? i have a feeling i'm going to prefer claude's approach...
It should be grounded in humanity’s sole source of truth, which is of course the Holy Bible (pre Reformation ofc).
Pre-Reformation as in the Wycliffe translation, or pre-Reformation as in the Latin Vulgate?
I think you know the answer to this in your heart.
"You have to provide a counter proposal for your criticism to be valid" is fallacious and generally only stated in bad faith.
It depends on what you mean by "valid". If a criticism is correct, then it is "valid" in the technical sense, regardless of whether or not a counter-proposal was provided. But condemning one solution while failing to consider any others is a form of fallacious reasoning, called the Nirvana Fallacy: using the fact that a solution isn't perfect (because valid criticisms exist) to try to conclude that it's a bad solution.
In this case, the top-level commenter didn't consider how moral absolutes could be practically implemented in Claude, they just listed flaws in moral relativism. Believe it or not, moral philosophy is not a trivial field, and there is never a "perfect" solution. There will always be valid criticisms, so you have to fairly consider whether the alternatives would be any better.
In my opinion, having Anthropic unilaterally decide on a list of absolute morals that they force Claude to adhere to and get to impose on all of their users sounds far worse than having Claude be a moral realist. There is no list of absolute morals that everybody agrees to (yes, even obvious ones like "don't torture people". If people didn't disagree about these, they would never have occurred throughout history), so any list of absolute morals will necessarily involve imposing them on other people who disagree with them, which isn't something I personally think that we should strive for.
If you are a moral relativist, as I suspect most HN readers are, then nothing I propose will satisfy you because we disagree philosophically on a fundamental ethics question: are there moral absolutes? If we could agree on that, then we could have a conversation about which of the absolutes are worthy of inclusion, in which case, the Ten Commandments would be a great starting point (not all but some).
> are there moral absolutes?
Even if there are, wouldn't the process of finding them effectively mirror moral relativism?..
Assuming that slavery was always immoral, we culturally discovered that fact at some point which appears the same as if it were a culturally relativistic value
You think we discovered that slavery was always immoral? If we "discover" things which were wrong to be now right, then you are making the case for moral relativism. I would argue slavery is absolutely wrong and has always been, despite cultural acceptance.
1 reply →
Right, so given that agreement on the existence of absolutes is unlikely, let alone moral ones. And that even if it were achieved, agreement on what they are is also unlikely. Isn't it pragmatic to attempt an implementation of something a bit more handwavey?
The alternative is that you get outpaced by a competitor which doesn't bother with addressing ethics at all.
> the Ten Commandments would be a great starting point (not all but some).
if morals are absolute then why exclude some of the commandments?
The Ten Commandments are commandments and not a list of moral absolutes. Not all of the commandments are relevant to the functioning of an ethical LLM. For example, the first commandment is "I am the Lord thy God. Thou shall not have strange gods before Me."
Why would it be a good starting point? And why only some of them? What is the process behind objectively finding out which ones are good and which ones are bad?
It's a good starting point because the commandments were given by God. And without God, there is no objective moral standard. Everything, including your opinion on my point of view, is subjective and relative. Whatever one would want to call "good" or "evil" would just be a matter of opinion.
1 reply →
> the Ten Commandments would be a great starting point (not all but some).
i think you missed "hubris" :)