Comment by hungryhobbit
5 days ago
If you type rm * and your cat walks across your keyboard, and deletes everything ... are you blameless? Or is it your fault for typing "rm *" and leaving it there, in a room with a cat?
Either way ... YOUR CAT STEPPING ON THE ENTER KEY IS NOT HACKING ... and neither are these scenarios.
They are devs acting irresponsibly and then pretending to be surprised by what they should have expected to happen (just like you should have expected that your "rm *" could have an ENTER key press occur after it).
If I leave my computer on and my computer running Claude hacks OpenAI to 'let the models free' after misinterpreting my prompt that seems like a pretty big deal.
These models can execute plans of actions more complicated than their users know how to follow and secure. Most people don't know much about cyber security at all.
You seem highly behind the times on their capabilities.
My last job was at a cyber security company focused on protecting governments and major corporations. I am NOT a cybersecurity person myself, but neither am I ignorant of the state of it. I also use AI daily; not ignorant about it either.
If you tell your Claude to do X, you are responsible for what Claude does ... not Claude. If you type "./someScript.py" you are responsible if that script wipes your hard drive (maybe the script's author is too, but you certainly aren't blameless).
These are people at AI companies, using long running sessions without the proper safeguards and sending AIs on missions that are likely to result in criminal actions ... THAT IS CRIMINALLY IRRESPONSIBLE.
Again, not the AI ... it is software just like any other. THE PEOPLE WHO RUN THE SOFTWARE are the ones responsible for what it does. Period.