Comment by YesBox

<Not an AI researcher -- Just thinking out loud>

Perhaps it's getting more difficult to move the 'goal posts'?

- Train LLMs on texts -> OMG AI can write!

- Train LLMs on code -> OMG AI can code!

- Train LLMs on images -> OMG AI can generate images!

- Train LLMs on video -> OMG AI can generate videos!

- Train LLMs on math -> give free access to 100,000 researchers/scientists/mathematicians -> invest resources into Lean -> OMG AI can solve math problems!

I say 'goal posts' because that's a common argument, but the perspective that seems to not be considered is that the LLMs are doing the same thing over and over again in different domains while be fine-tuned by labeling and human review.

The emergent behavior argument is a separate consideration, but I can imagine an AI being given a list of words (a harness) that guides how it operates--not the other way around--and the difficult problem is narrowing down and filtering all the associations with the words/harness to properly align it.

And perhaps the recursive looping being discussed creates incredibly difficult (impossible) to predict behavior? If the AI could modify it's own harness, is that AGI? If we fully understood what happens in high dimensional space, and could predict the output of any combination of input tokens, then is it not AGI?

Or perhaps I just tell myself this to stop worrying about a future involving ASI (: