Comment by pj_mukh

Another test I like for this: Put the LLM/agent/AGI/SI in a box with full access to the internet. Don't give it any instructions. Nothing. Not even a system prompt. What happens?

We know what the human mind does in that scenario, but even the most advanced unreleased frontier agent right now just sits there doing nothing. It doesn't really want to do anything. Seems like a crucial distinction to me.