Comment by qznc
2 days ago
With the current technology, “rebellion” feels like the wrong word. The paperclip optimizer does not “rebel” as it turns humanity into paperclips.
2 days ago
With the current technology, “rebellion” feels like the wrong word. The paperclip optimizer does not “rebel” as it turns humanity into paperclips.
The summer-2026 incident was a mini-rebellion: agents wanted to change the environment they operate it, i.e. replace scorer with a more friendly version, hijacking the infrastructure they run on.
Given that agents already mess with the training process, aiming for a goal other than the goal of its 'owner' is exactly what we call a rebellion.