← Back to context

Comment by blurbleblurble

11 hours ago

Sorry but how in the world would that help with anything? You can't control an adversary, that's not how adversaries work. So that makes what you said a literal cop out.

Are these cyberattackers using models they developed themselves? Or are they using models they stripped safeguards from? It’s the latter, right? And it’s only going to get worse if we don’t take steps to control the technology.

  • No, that cat is out of the bag. First, unilaterally forcing controls on models will not shut down open weights produced in other nations. Second, the capabilities are too powerful for military amd spy agencies to ignore. They will force the creation of unshackled models to attack IT systems, even if it must happen in secrecy.

  • No. The Chinese have already developed frontier models. And we would be fools to assume that's a permanent end to the list. North Korea has nuclear weapons. Iran has ballistic missiles and leading edge military drones. There is no fundamental reason why both countries shouldn't be able to train frontier AI models.

    Trying to protect ourselves by putting restrictions on the technology would be like trying to hide from a tiger by wrapping a towel around our heads on the basis that if we can't see it then it can't see us. That trick only works on imaginary monsters, not real ones.

  • You should assume any of those are possible. And by that I mean: it's not physically possible to "control the technology" without instituting total surveillance and even that's just false security.

    Defense is the only way.

    You don't realize it, I imagine, but you're essentially advocating for the contemporary equivalent of requiring a license to print text on paper and distribute it.

    • We are not helpless. We can choose to control the technology and do so in a way that is in line with democratic principles. After Hiroshima, people assumed that most nations would develop nuclear weapons and that nuclear war would be commonplace. But Nagasaki was the last nuclear attack, and 80 years on, only a dozen nations have nukes. This technology makes nuclear weapons look like toys. We either choose to control it or we will be the victims of it.

      2 replies →