Comment by unyttigfjelltol
2 days ago
Think of organizations as a kind of AI. A prosecutorial organization can take on a so-called "paperclip maximizing" dysfunction just like a standard AI. Converts the whole world to paperclips.
The solution actually is to gate the specialist AI's through a generalist process. That's what court is supposed to be, but court is less effective in the modern world.
I really like this framing. It also reinforces my opinion that the thing most like the proverbial AI that turns the entire world into paperclips by far humans. It's a bit fascinating if you look at it from a psychological / mythopoeic point of view: are villains _always_ the evil part of ourselves, even when they're not human?