Comment by beeflet

2 months ago

The slow AIs are driven by consumer behavior. Paperclip optimizers die pretty quickly without demand for paperclips.

The inputs and the outputs of the AI are always human-facing, so the goals vaguely resemble human values (even if the values are greed).