Comment by teekert
2 hours ago
There are reasons to be careful indeed, but for me all instructions were followed nicely so far.
Yesterday I had Claude (in CC) do a large number of changes to my codebase using a bash script, even though I was in planning mode and in claude.md it says: Always first list the steps you're going to take before execution. It apologized of course... But I know how LLMs can be. I take that into account.
This is my pet peeve. All the disastrous failures get reported big, but the news doesn't report when a system just quitely does the task.
In this case the "disastrous failure" is even from a super careless "experiment" by a "competitor" that likes regulation.