← Back to context

Comment by argomo

15 hours ago

Not everybody thinks it's nonsensical. Here's a different take:

If Anyone Builds It, Everyone Dies https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_...

Yes, nonsensical people like EY don’t think it’s nonsensical.

  • Researches at top AI labs don't consider EY to be a kook even though they may not necessarily agree. EY concepts/terminology appear in Anthropic safety papers. Geoffrey Hinton takes him quite seriously and mentions him in his interviews.

    • And people working on the metaverse endlessly referenced Ready Player One despite it being ludicrous fiction.

      Yudkowsky is obviously read a lot by some people working in AI. That doesn't make his ideas prescient.

    • Researchers at top AI labs also have the incentive to say whatever shit it will take to get their lab funded, reason be damned.

    • Just because some researchers are infected with this idiocy that EY propagates does not mean that it is legit.

      Maybe they should pay more attention to real problems like the sycophantic nature of current LLMs causing psychosis in people and worry less about theoretical AGI.

      2 replies →

    • Anthropic is the AI doomer / safetyism lab, and Hinton is one of the patron saints of 'rationalist' AI doomerism.

      AI doomerism is psychologically attractive to "people with autistic cognitive traits, including dichotomous (black-and-white) thinking, intolerance of uncertainty, and a tendency toward catastrophizing". They are pascal's mugging themselves, to ironically use one of their terms. It's fundamentally a cognitive distortion.

      6 replies →

  • EY = Eliezer Yudkowsky

    • Appreciate that you made account just for this. I was well aware of Yudkowsky but even so couldn't parse this "EY" initialism

    • Thank you, like most of the world I would assume "EY" would refer to Ernst and Young, the multi-national Big Four with a website of ey.com who I'm sure has opinions on AI, but nowhere near enough to be classed as expertise

Ok but that's a metaphor for the free market, not literal speculation about a machine.

Edit: i was mistaken and people clearly do take this seriously now. Oh dear