Comment by estearum
7 days ago
hmm almost like the exact race-to-the-bottom + arms-race dynamic all the doomers have been warning about
7 days ago
hmm almost like the exact race-to-the-bottom + arms-race dynamic all the doomers have been warning about
One man's offensive penetration tool is another mans defensive tool. In the recent HuggingFace/OpenAI incident the safety controls stood in the way of the defenders, not the attackers:
https://www.thestack.technology/hugging-face-hacked-turned-t...
You're presenting further evidence of lack of effective control over these systems as... a mitigating factor...?
Apparently, the attacker in the Hugging Face case was reported to be an internal OpenAI model trying to break into HF and steal the answers to cybersecurity benchmarks: https://openai.com/index/hugging-face-model-evaluation-secur... It really doesn't matter what restrictions are placed on public use of models if the attacking models are internal models at the AI labs themselves.
So if the AI labs are literally running rogue models breaking into other organizations' servers, then yes, I am OK with those organizations self-hosting Chinese models for defensive use.
3 replies →
Why do you assume they're disagreeing with you?
1 reply →
Race to the bottom for the investors, utility for the rest of us. The future is already here, it’s just not evenly distributed yet (Gibson).
Doom for whom?
Well considering it was just a few months ago that OpenAI had the brilliant idea of connecting these systems to autonomously run an actual protein synthesis wetlab, very possibly all of us.
Holy shit, how’d I miss that? https://openai.com/index/gpt-5-lowers-protein-synthesis-cost...
Forget Iran, this place is what we’re going to wish we’d bombed.