← Back to context

Comment by shafyy

7 hours ago

Watched one too many second-tier disaster movies?

One the one hand, it does sound like one of those movies.

On the other, Idiocracy turned out to be quite prescient.

(Most likely, we'll have some combination of human stupidity, LLM stupidity, and way too much compute in one place all working together to create a perfect storm of unchecked hacks that break something or other that ends up killing people in an unintended way. Then there's some half-hearted attempt at cleaning things up so that business can proceed as usual in an even more broken world, rinse and repeat.)

  • Not saying that the current civilizations will never end or be shattered to pieces. Looking at history, many civilizations did. But saying LLMs are the highest risk factor for this is just insanity, based on all what we have seen so far (and based on these AI companies crying wolf, I mean, remember just a few months ago that Anthropic saying that Fable is too powerful to be released?)

    • Oh, I agree. I don't think LLMs will end civilization. I'm guessing climate change will cause many more deaths than LLMs. But I think LLMs will cause some too. (And not in one of those impressively smart ways as it's presented from the OpenAI fearmongers, just in a stupid "we vibe-coded the sandbox for our bruteforce SCADA-hacking agent experiment and oh no it did what we told it to do" way.)