Comment by Isamu

That is a conflation of LLMs (which have clear limitations) and complex harnesses of which an LLM is one component.

I think it is clear that future AI may incorporate an LLM as a component but the current concept of LLMs are a transitional form that will give way to more capable composite models.