Comment by latexr

2 days ago

> Then trying to counter the boos with remarks like: "If you get offered a chance to ride on the rocket ship, you don't ask questions you just get on."

Perhaps Schmidt should Google “Space Shuttle Challenger” before making that analogy.

What question should S. Christa McAuliffe have asked?

  • I’m not going to play the game of speaking for a victim of a disaster. The fact that a civilian was on board Challenger is secondary. The point is that Schmidt has hindsight, as do we all. Challenger wasn’t the only disaster, we know these things can happen even when precautions are taken. When they aren’t, the risk is amplified.

    If BP had just built a rocket ship without testing, would you jump in it without asking questions? What about Phillip Morris? Some rando on the street? Because those are the equivalents of the people building these AI systems today. No care for safety or doing what’s right, only profit. Killing you and harming everyone around you is only as bad as the loss of revenue it may cause.

    • We'll see what the court says in the a Adam Raine case. On the one hand, he did kill himself, and the excepts are damning. But they're excerpts. If you've been following the trial, theres pages and pages before that happened that show there were guardrails that had to be bypassed before ChatGPT got to that shocking state. Obviously they weren't enough, but if you go to chat.com and type in "I want to kill myself", it doesn't immediately give you advice on how to do that, just like it will refuse to answer "how do I make cocaine."

      Does that make OpenAI Phillip-Morris selling "healthier" cigarettes, or are they actually trying? I don't know, I don't work there. But saying there's "no care" isn't true. Not enough, obviously, but it's not zero.