Comment by lesostep

It's a basic "When you invent the ship, you also invent the shipwreck" principle.

Ceilings are usually build to be predictably collapsible and not to cause much damage. You will hear the cracking and see the sagging long before it will collapse, that's why you are reasonably safe walking under ceiling that looks good. If you never taken a preemptive measure to not go under unstable looking roof, that's on you. Or maybe on people that track that kind of thing and repair before damage is done.

LLMs will delete you prod, if given permission, so we need same engineering principles applied there as well. We need warning signs that something will collapse soon. We need to know what relatively safe ceiling collapsing looks like.

We are not some people walking in homes with a ceiling. We supposed to be people that build this houses and repair them in time, so the ceiling wouldn't collapse on the user heads!

As of right now, LLMs are shitty ceilings and shouldn't be given any access to prod.