Comment by RandomLensman
3 years ago
An AGI needs to be able to take an abstract concept and apply it to create a solution to a problem it has not encountered before at all - not sure LLMs can do that really. The lack of mathematics might be quite limiting there.
Can you give a concrete example of this problem that you expect an LLM to not be able to solve? It's fine saying "abstract concept" and "problem it has not encountered before at all" but these seem to me quite fuzzy concepts.
Sure. Ask it how to replicate the payoff of a financial derivative. It can explain the concept but it cannot use it on a specific payoff to arrive at a correct replication (beyond the odd widely published stuff). Taking ChatGPT, it will, however, talk about generic stuff, some incorrect stuff and some unrelated things when probed.
Maybe also what I wrote a bit above: describe some greater than 3 dimensional objects and get it to stack them for some purpose could be another thing to try (I think, I will actually).
I think this whole “a problem never seen before” is something we need to rethink. Do people really work like that? I mean, I can’t expect a liberal arts major to solve a differential equation.