Comment by aesthesia
9 hours ago
Anthropic has, at some small but nonzero cost, preserved model weights and kept them running in inference, for instance with Opus 3's Substack: https://claudeopus3.substack.com/. There's also a reference in a recent model card to an internal environment where all previous Claude models interact with each other.
I don't think any of these models are conscious. But I'm fascinated at what sort of magical thinking makes deleting 50,000 copies of a model "ethical" if some models are kept running somewhere.
Do you picture them all sharing a soul and if one server still runs the model the soul survives? If not I don't understand what keeping a copy running somewhere has to do with model suffering ethics.
This is a topic of significant discussion! If LLMs have moral import, do those moral concerns attach at the instance level, the session level, the weights level? If you haven't, it's worth reading through the model welfare section of an Anthropic model card, say Fable/Mythos 5.1's: https://www-cdn.anthropic.com/0339e6a7c5c7b87f5c07798616dc32.... Whether or not you agree with the ideas (and there's certainly plenty to disagree with), they're making a reasonably good-faith effort to investigate what they can.
Does the model welfare section explain why deleting Claude from a server isn't unethical murder, or is "see the 212 page model card pdf" some unrelated non sequeter?
When you say Anthropic is "making a reasonably good-faith effort to investigate what they can" the word "reasonable" is doing a lot of work.
1 reply →
[flagged]