Comment by Zambyte

3 days ago

You said:

> I haven't seen one convincing model of AI existential risk. Can anyone offer one?

I apologize for answering. This is the only episode of this podcast I have ever watched, and I have watched it four times now. The person being interviewed knows what they're talking about. You would learn from them.

But why do you think they know what they’re talking about? That’s the problem with that show. It platforms people with no guardrails to stop quacks.

  • As much as I hate appeal-to-authority based arguments, it's basically the only way I can see how to answer this without just totally rehashing the things he says in the video. He was an AI forecaster at OpenAI for several years. (I think 2019? to 2024). He quit on the grounds that OpenAI (as well as the rest of the industry) were / are throttling towards RSI irresponsibly, and even refused to sign an anti disparagement clause on exit at the risk of losing 2 million dollars (80% of his family's net worth) so he could talk freely about OpenAI. Now he runs a non-profit that does AI forecasting and advocacy.

    https://www.aifutures.org/

    https://ai-2027.com/

  • Sometimes the most interesting people are people with ideas outside of the same groupthink circle. Everyone who has changed society has been called a quack by a square.