And my point is that using Claude models for coding a Boeing plane does not allow anthropic to interfere in the operation of those planes. Once the code is written, anthropic has not plausible form of control.
Do you remember the Fable release? Anthropic themselves said they'd sabotage code of certain groups they didn't like such as frontier AI researchers. Why do you think they couldn't do the same here?
It is if the auto generated code for say safety critical or mission critical code generated by a LLM or even someone tries to put LLM in the decision loop and it refuses to do an action.
And my point is that using Claude models for coding a Boeing plane does not allow anthropic to interfere in the operation of those planes. Once the code is written, anthropic has not plausible form of control.
Thus, it cannot be a supply chain risk.
Do you remember the Fable release? Anthropic themselves said they'd sabotage code of certain groups they didn't like such as frontier AI researchers. Why do you think they couldn't do the same here?
No, they said fable would stop working. That's very different. (Unless you're talking about anti-distillation stuff which is again, not relevant)
1 reply →
It is if the auto generated code for say safety critical or mission critical code generated by a LLM or even someone tries to put LLM in the decision loop and it refuses to do an action.