← Back to context

Comment by seaucre

8 hours ago

I keep seeing this assertion. What regulations have they proposed that would have prevented this new model? I thought they want to pace the frontier, which this model is not.

You are taking their words literally, rather than looking at the side effects of any effort to "pace the frontier".

Dario has not (and will not) say he wants to ban Chinese models outright. But:

1. He's made many posts about how he thinks "dangerous" models are bad (https://www.anthropic.com/news/position-open-weights-models)

2. He writes posts proving Chinese open weight models are "dangerous" (https://insightsintegration.com/anthropic-warns-of-advanced-...)

3. He talks about about how he wants stronger govt regulation of AI (https://www-cdn.abcnews.com/Business/exclusive-anthropic-ceo...), and explicitly mentions he does not trust China at all and doesn't want them to have Mythos.

Do the math: 1 + 2 + 3 = he wants to regulate/ban the Chinese open weights.

Of course, Anthropic and OpenAI will then write posts about how their own models are dangerous - but that's okay, they're the good guys.

  • Honestly, open weight models are dangerous, and I haven't seen a single convincing argument against that.

    • Not being able to audit my own software and configurations for vulnerabilities is dangerous. Consolidating power over the majority of Americans' jobs is insanely dangerous. Need I continue?

      There are no choices here which do not carry risk. I haven't seen a single convincing argument against these points.

    • I'd argue that OpenAI and Anthropic are far more dangerous and I also haven't seen a single convincing argument against that.

    • Other things that are dangerous: kitchen knives, cars, household chemicals, not tying your shoelaces, political parties, water. Danger is a normal part of life. Rather than regulate or ban anything dangerous, what we normally do is assess specific risks, and only put a limited amount of regulation in place where it's absolutely needed to prevent the most harm.

      We also put responsibility on humans to act responsibly. In theory, it's absolutely insane to allow human beings the ability to walk into a street with automobiles, because obviously they will be killed! But we don't ban them from walking there, and we don't ban cars, because it's pretty uncommon for people to walk directly in front of a moving car, despite there being obvious danger.

      Ultimately the biggest risk of AI isn't the AI. It's what human beings do using the AI. Just like with hammers, knives, drills, chemicals, cars... we regulate the human's actions and create laws to direct their use, rather than regulate the items themselves.

Go read Dario's screed on GLM, or his other one one on how your toaster could be part of a distributed open model that self replicates. Every second blog post is some doom scare about the dire consequences of open models. Go look at the new ToU [0] which are now pages and pages of things you can't do with Anthropic models. Check how they will ban your account if you are persistently mean to Claude now.

He's completely transparently campaigning for regulation. It must be very frustrating to him that the Trump admin is completely non-responsive. He probably thought Anthropic would have the whole market stitched up and water tight by now.

[0] https://www.anthropic.com/legal/aup

Literally zero, but that never stopped a good conspiracy theory, especially when half of HN hates the big labs because of fear for their own economic future.

OpenAI and Anthropic aren’t even slightly worried about DeepSeek.

  • Having looked at the sentiment around DeepSeek's models around this thread as well as my own experiences with it I'm going to need a little more to back up that assertion about OpenAI and Anthropic not being at least a little bit worried about DeepSeek...

    • I’ve been listening to this rhetoric about the open models eating O/A’s lunch for like 18 months, meanwhile their revenue is up what, like 50x?

      May this kind of worry find me…

  • People like open models because they are free/cheap. It's not anything deeper than that. Most people will hop in whatever van is handing out free candy.

    • It’s about capability.

      The model makers are bricking the models with their system prompts, and even the tools are tamper proof.

      You can only use it their way. They think we’re stupid.

      And their way is the shit way, the babyproofed way, while they talk to you about their unfucked models hacking out of their labs and hacking into other labs, and reminding you you have zero rights.

      Fuck them twice, then once more… This is about compute. Who owns compute. China is saying fuck you all we can scale things bigger than you can imagine. And they can! They have so much more energy! Theyre closer to commercial fusion than us too. Meanwhile our guys are trying to… regulate? Lol

      2 replies →

  • > I keep seeing this assertion. What regulations have they proposed that would have prevented this new model?

    > Literally zero, but that never stopped a good conspiracy theory

    Are you living under a rock and never read any of Dario's blog posts?

    Let me give you an example, here: https://darioamodei.com/post/policy-on-the-ai-exponential

    Section "1. *Regulation* and public safety" (emphasis mine), then under it:

    > AI companies that develop advanced AI models must have strong security standards that protect their model weights

    You can't "protect model weights" if the weights are openly available, ergo this is an explicit call for regulation to make open weights illegal.

    • You're the one extrapolating that cherry-picked sentence to mean "open weights should be illegal", but that extrapolation doesn't make any sense, and it's hardly "explicit".

      Presumably you'd want the AI companies to protect their weights to keep them from falling into the hands of bad actors. But the US can't make open weights illegal anywhere except the US, which does very little to keep them out of the hands of bad actors (most of whom are outside of the US).