Comment by Zak
18 hours ago
The purpose of firing a person shouldn't be vengeance but to remove someone who is unreliable or not cost effective.
It's similarly reasonable to drop a tool that's unreliable, though I don't think that's a reasonable description here. Instead, they used a tool which is generally known to be unpredictable and failed to sandbox it adequately.
The purpose of firing a person is to remove someone unreliable, but also, the person having that skin in the game makes him behave more reliably. The latter is something you cannot do with an LLM.
The cold hard fact is: LLMs are an unreliable tool, and using them without checking their every action is extremely foolish.
"The cold hard fact is: LLMs are an unreliable tool, and using them without checking their every action is extremely foolish."
You mean checking every action of theirs outside the sandbox I suppose? Otherwise any attempt at letting an agent do some work I would consider foolish.
The AI company has skin in the game which motivates them to produce reliable AIs.
Can you actually sue Anthropic over this when they clearly state that AI can make mistakes and you should double-check everything it does?
1 reply →
Doesn't seem to be working though. :(