← Back to context

Comment by juanjmanfredi

3 days ago

Yudkowsky seems unconvinced.

https://x.com/allTheYud/status/2110805233454731449?s=20

What are his actual credentials? What did he achieve? Isn't he just some random dude on the internet? Why do people care what he says?

  • > What are his actual credentials? What did he achieve?

    He cofounded the Machine Intelligence Research Institute, an organization focused on AI alignment, in 2000, way way before it was a trendy topic.

    He's also partially responsible for popularizing ideas such as the orthogonality thesis and instrumental convergence.

    > Isn't he just some random dude on the internet?

    Not really, most random dudes on the internet were not researching AI alignment in 2000.

    > Why do people care what he says?

    Many people were introduced to the concept of AI alignment thanks to him, so they are naturally interested in reading his reaction to progress in the field.

  • He tells spooky stories on the internet to make money. He has told numerous spooky stories. Yes. Spooky stories grab the attention of many people (understandably, given all the wars and plagues and famines in previous centuries).

    • yes, he's an author fist and a researcher/scientist second. He has no peer reviewed publications in his name.

    • > He tells spooky stories on the internet to make money.

      I mean, yes, but so does the author of this article. It's literally his business. The article is, in part, an advertisement for what he sells.

      I disagree with Yudkowsky on almost everything and I think the philosophical movement he co-founded is a pox on the SF Bay Area tech culture, but I don't think we can deny him credibility that's comparable to the credibility of the author of this article (who, as I understand, is a young guy who spent some time at OpenAI). They both know what they're talking about and both are motivated to reach specific conclusions.

      1 reply →

That's because he's worried about super-intelligence. If LLM's are a normalish tech this is a good step

[flagged]