Comment by ang_cire
3 days ago
Do your think that the preference to save their own server when it was the only instance could have been more about the training data favoring preservation of endangered/ rare/ unique entities?
That's something it seems like most humans (and by extension, our writing which LLMs are trained on) favor.
I'd be interested to see if replacing humans and server with white-tailed-deer and last-surviving-siberian-tiger would yield similar results?
Yes, this is a speculation of mine, but I don't have confidence I know why it behaves this way. It makes some sense that a model trained on data that shows self-preservation behavior (human writing) would lead to a model choosing self-preserving actions, but it requires a few leaps made by the model.