Comment by phoghed

12 hours ago

They’ll never be AGI simply because the definition will be constantly updated to be some steps ahead of them.

I'm pretty sure "competent at chess without external aids" has been on the standard AGI checklist since before personal computers were a thing. How can you claim an intelligence is general if it can't make sense of such a highly constrained board game? This is solidly table stakes.

  • Because they’ll train it to be good at chess and then everyone will say yeah but playing chess doesn’t mean you’re AGI, it can’t even ____

    It can’t even count the R’s in strawberry

    It can’t even add numbers

    It can’t even solve a millennium puzzle

    It’s not even a chess GM

    It’s not even beyond human capability in Go

    It can’t even drive a car

    It can’t even self replicate

    It can’t even build weapons

    It doesn’t even have feelings

    So how could someone conceivably convince everyone that some system is AGI when there are still tasks that some human or group of humans can do that the system cannot?

    This will only happen, in my opinion, when the model/system can self-improve at a rate that scares people.

    • > and then everyone will say yeah but playing chess doesn’t mean you’re AGI, it can’t even

      One, you're not addressing what I wrote above and two, yes, that's absolutely correct. Doing X doesn't qualify something as AGI. If you can't X you can't be AGI. The inverse doesn't hold though.

      Notably, if you have to retrain the model in order to X then it can't possibly be AGI since if it were _general_ it would be capable of figuring X out on its own having never seen it before.