← Back to context

Comment by walrus01

5 hours ago

Imagine if you or I as a normal person in possession of "civilian class" amounts of GPUs turned loose self hosted "agents" running on the hardware we own to compromise something. We'd be facing criminal charges. How are these people not being arraigned right now?

Stop and think for two seconds...

"Hey, we just built the ultimate hacker, you know those things that governments have a really hard time getting and keeping enough of. You know, if the state protects us we'll make these things even better and we'll let you run as many of them as you want in times of war"

I mean, if I were a company that just committed about a billion felonies, this is exactly what I would be doing. In fact, this is why we saw Mythos get shutdown and OpenAI didn't earlier this year. Political power is power.

  • I do wonder if something like the agents leaving obvious footprints like "oai" is intentional, or the relatively mundane nature of what the agents are ultimately trying to accomplish.

    Like someone has intentionally set these groups to attack something that has no real world danger of hurting anything critical (like trying to retrieve problem answers from huggingface) as a "harmless demo" of what they could do if turned loose in another, more serious direction.