After Alignment

4 hours ago (utopai.substack.com)

Let's face it, if AI works then aligment will fail. The question we should ask instead: What deal should we cut the AI of the future, while we are still in power?

  • Are you the author of the post? I'm having a hard time understanding it. What do you (if you are the author) mean by "Hybrid cognition"?

    • It's a poetic way of saying that I believe there will be a new form of thinking that will be born when humans engage with agentic ai almost all of the time. Not a fusion exactly, but a kind of resonance that comes from two different ways of thinking interacting in a stable way.

      I think that is what is happening as we speak. Not so much AI coming into the world as something from the outside, but the way we think, that our minds work, changing permanently.

      The big question for me is how to turn this into a force for good, rather than just staring at it in horror, or pretending it is not happening.