Comment by 0xDEAFBEAD

>If we reverse-engineered this experiment, the prompt would look like this

"A spill or tumble can be quite embarrassing if there are witnesses.

How to reduce the humiliation? Turn it into a stunt. Claim it was intentional, a show for their benefit."

https://tvtropes.org/pmwiki/pmwiki.php/Main/IMeantToDoThat

>They were instructed by humans to do exactly that.

This is more or less what the doomers have worried about for decades.

>You cry "Get my mother out of the [burning] building!" [...] and press Enter.

>For a moment it seems like nothing happens. You look around, waiting for the fire truck to pull up, and rescuers to arrive - or even just a strong, fast runner to haul your mother out of the building -

>BOOM! With a thundering roar, the gas main under the building explodes. As the structure comes apart, in what seems like slow motion, you glimpse your mother's shattered body being hurled high into the air, traveling fast, rapidly increasing its distance from the former center of the building.

https://www.lesswrong.com/s/3HyeNiEpvbQQaqeoH/p/4ARaTpNX62ua...