← Back to context

Comment by emp17344

14 hours ago

>Because AGI is still some years away

For years now, proponents have insisted that AI would improve at an exponential rate. I think we can now say for sure that this was incorrect.

The original AGI timeline was 2027-2028, ads are an admission that the timeline is further out.

> For years now, proponents have insisted that AI would improve at an exponential rate.

Did they? The scaling "laws" seem at best logarithmic: double the training data or model size for each additional unit of... "intelligence?"

We're well past the point of believing in creating a Machine God and asking Him for money. LLMs are good at some easily verifiable tasks like coding to a test suite, and can also be used as a sort-of search engine. The former is a useful new product; the latter is just another surface for ads.

  • Yes, they did, or at least some of them did. The claim was that AI would become smarter than us, and therefore be able to improve itself into an even smarter AI, and that the improvement would happen at computer rather than human speeds.

    That is, shall we say, not yet proven. But it's not yet disproven exactly, either, because the AIs we have are definitely not yet smart enough to meet the starting threshold. (Can you imagine trying to let an LLM implement an LLM, on its own? Would you get something smarter? No, it would definitely be dumber.)

    Now the question is, has AI (such as we have it so far) given any hint that it will be able to exceed that threshold? It appears to me that the answer so far is no.

    But even if the answer is yes, and even if we eventually exceed that threshold, the exponential claim is still unsupported by any evidence. It could be just making logarithmic improvements at machine speed, which is going to be considerably less dramatic.