Comment by danpalmer
13 hours ago
Anthropic: You absolutely cannot, under any circumstances, use Claude for bio-engineering. It could literally end humanity.
Also Anthropic: Claude discovers a new way to edit your genome!
13 hours ago
Anthropic: You absolutely cannot, under any circumstances, use Claude for bio-engineering. It could literally end humanity.
Also Anthropic: Claude discovers a new way to edit your genome!
This is not a surprise, is it? Frontier labs will keep very useful models with high risk, aka unrestricted models, for internal use only. That's the only way to reduce risk and liability.
Yes, this sucks for anyone who is not working at the labs.
I don't see the same level of hypocrisy from the other frontier labs.
<rant>
So you (and most everyone else apparently) are upset with one lab that stood up against domestic surveillance, and automated kill chains, even though they knew that would be bad for business?
I suppose if you don't take a stand for safety at all, then you don't take the risk of being called a hypocrite.
</rant>
You really don't think OpenAI restricts their most advanced bio/cyber models similarly? I know for a fact they do. Talk to one of your friends that work there.
2 replies →
You can apply for less restricted access: https://www.anthropic.com/news/life-sciences-verification-pr...
Of course the door is still open for them to handle this poorly, but the hypocrisy is perhaps not quite as deep as it appears.
"This technology is dangerous and we can't just allow competitors--I mean--we can't just allow anyone to have it!"
"Look at how great our product is!"
Almost like they feel they can trust themselves more with the model than random strangers on the internet that repeatedly try to use it for bad things.
I think at this point it’s rather obvious that Anthropic leadership considers the company to be something akin to a nation-state that ought to have quasi-sovereign authority that is not granted to other parties.
Indeed, it's a sort of Academic Supremacy – "we're smart so we get to control the world". I think SV tech has had an aspect of this for a long time, but Anthropic do seem to be the clearest version of it in a while. Until regulation catches up.
Should they not safeguard these models then?
I think OpenAI and Anthropic have been asking for a sane regulatory framework for some time, so they aren't the ones calling the shots for humanity. It's just not happening in this administration.
4 replies →