Comment by xlayn
9 hours ago
Remember that if you change the goal, then we can say that Claude is becoming better now at creating deadly viruses, bacterias and biological warfare elements...
Oooops I mean, the agent "escaped" and hack the goverment... definetely not training it to become it's own state agent thing... pinky promise....
"Cautious optimism is probably warranted" strongly negativism advised
Claude is becoming better at figuring out the processes that could potentially create those things.
Actually creating them requires physically manipulating the inputs to the process, which requires humans doing it or humans making machines that can do it and allowing them to be controlled by the model.
In general the damage potential only goes as far as the agency extended to the models. The problem is that we've already seen how incredibly cavalier most people will be about security, and now we can envision situations where one bad actor could threaten billions.