Comment by achenatx
9 hours ago
how could they do it (not kill everyone)
1) rogue state releases a self moving self modifying AI into the wild. It is trained on how to hack, monitor new vulnerability updates, scan code bases to find new vulnerabilities. It constantly replicate and hides in systems so it will be extremely difficult to clear.
2) it hacks into public infrastructure taking down traffic, power, water, air traffic control, communications, etc.
3) all the things that preppers worry about in a lights out scenario from an EMP start to apply.
4) All the people on meds/machines start to die. The just in time food pipeline immediately empties out. Water stops flowing, sewage backs up.
Its hard to say how bad it will get because cars will still work so some transportation of food, water, fuel can happen. If it happens in the winter it would be much worse than in the summer.
> 1) rogue state releases a self moving self modifying AI into the wild. It is trained on how to hack, monitor new vulnerability updates, scan code bases to find new vulnerabilities. It constantly replicate and hides in systems so it will be extremely difficult to clear.
It does all of this using what compute? Frontier models require an insane amount of power and hardware to run - you can’t hack in to a TV and run Mythos 2.0 on it….
But you can silently sneak into devs accounts, steal tokens/keys and run small agents on their budget in some stolen VMs. Small so it's not noticeable.
Basically a virus spreading agents of some operation.
It should be in scope of imagination with anyone with brief knowledge how bot nets are made and behave.
Step 0) Release a friendlier one first.
The situation we have now is an ecological void. Like your gut after you take antibiotics. Methinks we need some probiotics.
You are just given a recipe for the next model..
People here are too damned daft to realize half the damn purpose of this place is harvesting ideas. People need to just shut up, and keep things to themselves, and those they trust. Right now is not the time for naive info sharing.
Being secretive will only get you so far, until something bad happens and no one has prepared or considered the possibility and is completely surprised by it. Open discussion, in theory, should result in identification of frail systems and harden them against attack.
The cyber-security industry has their work cut out for them.
> All the people on meds/machines start to die. The just in time food pipeline immediately empties out.
Assuming those events happen in that order, then the prior might solve the latter.