Comment by stephbook
1 hour ago
We've had movies like Terminator, Matrix, or i, Robot. Black Mirror Metalhead. Boston dynamics robo dog with a knife or a gun. Humanoids doing back flips. Memes making fun of how we are going to fight these for access to water.
The intelligence is there and so is the physical incarnation.
Google's models fold proteins better than humans and Covid might have been engineered and inadvertently escaped from a lab.
But when CEOs warn of that, they're dismissed as scare mongers. Why? Are only powerless internet commentators allowed to be fearful?
They aren’t attempting to self-regulate. On the contrary, it seems like they’re doing whatever they can to bring about any possible threat as fast as possible in order to get legislation. Regulatory capture is what everybody is saying is their goal and I think that’s easier to believe
They are obviously trying to self regulate. That's the whole point of the calls to pace the frontier. See Anthropic's launch post for Opus 5.5 where they got third party sign off on its safety, or see the launch post for Astra where OpenAI explicitly calls out the safety improvements made on HuggingFace-esque evals. Self regulation won't help if other labs don't play ball, though.
> Self regulation won't help
You got it
They are obviously trying to self-regulate and correctly realize that competitive pressures will render these efforts ineffective, and have communicated this to everyone.
Kind of makes you wonder why they built the tech in the first place, I don't know if we're on the eve of the apocalypse or not, but why the fuck build it all and then run around telling us how dangerous it is when...they were already warned?
Bit strange no?
I'm a bit fatalistic about it all now. The cat is out of the bag, unless we see some never seen before leadership from the current US admin there is almost zero point in worrying about it. Not going to pretend what the future holds but it's looking unpredictable, as usual :)
But when CEOs warn of that, they're dismissed as scare mongers. Why? Are only powerless internet commentators allowed to be fearful?
Well are they going to stop developing the tech or not? If not, then you can see why people don't trust what they're saying. I mean if it's that dangerous, why not step down from your role as CEO to demonstrate how seriously you take the threat? Why not immediately call a pause on all training, today ?
holy heck, thank you for the moderating dose of sanity. HN comments feel like a death cult lately. All I can think is that this is intelligence addiction speaking.
I say this as an intense user of these tools. But they should rightfully be understood as terrifying, and their continued frontier development is imho not safe.