← Back to context

Comment by bko

2 hours ago

What would convince you that it is AGI?

I always here things like "oh it's useful but dumb on some things", but it's just vague.

What is the test? What is a question that it fails at compared to humans? And no, you can't just say "find me the cure for cancer", but I believe there is probably enough intelligence in the weights that there is likely a cure in there with enough compute and the right questions.

The fact that you need to ask "the right questions" is why it's not AGI. A general intelligence should be able to ask of its own volition the interesting questions required to advance its goals.

I can’t predict how a novel intelligence could prove to me that it is intelligent. A novel intelligence would have to work out how to do that for itself