Comment by Topfi

17 hours ago

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout?

A sandbox, mind you, that is not really worth being called that, unsuitable for the task at hand and has been breached after models coordinated in a manner visible to OpenAI on multiple occasion, but seemingly no actionable learnings are taken from each instance.

Will say, I have lost any faith in OpenAIs commitments and their statements post the Huggingface hack, seeing as they proceed like this and are rolling out Astra within a timeframe so brief to it, there is no way an actual post mortem was doable (see also METR mentioning the time pressure [0] they were under in assessing the hack).

[0] https://metr.org/blog/2026-08-26-openai-hugging-face-inciden...

The answer would be more obvious if you used the active voice instead of the passive voice, one of the basic requirements of clear thinking.

> Why did the White House force Anthropic to remove their model from access for any non-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" and the White House has expressed seemingly no desire to block the upcoming Astra rollout?

  • Yeah, probably (let's be honest, most certainly), right given the Admin. Avoiding commenting on my assumptions regarding the modus operandi in current day US politics because I only know it through reporting though and I really tend to dislike when people outside e.g. the EU comment on our politics in what is a very clearly narrow, uninformed manner. So it'd rather avoid altogether and occasionally ask, mainly if maybe I missed something and there actually is anything besides pure old "lobbying" to explain the difference in behaviour.

    Still am mainly interested why Amazon ran to the government though regarding Fable 5, I can get the angle concerning the relationship between OpenAI and the administration easily, but not the way Amazon operated. They had more to loose what with their major buy-in by Anthropic on AWS.

    • If you have followed news reporting, you probably heard that SamA was touring D.C. to make sure this release went without any regulation hiccups. If anything, they learned how to play the whole politics game - especially after the Anthropic fiasco. And even though all parties involved are terrible choices, more eyes on a potentially civilisation altering product does make me feel minimally better.

      6 replies →

    • As an American we tend to (especially lately) make our politics into everyone's problem so feel free to comment on our politics as much as you like until further notice.

      17 replies →

    • US commentators are often incredibly misinformed about their own country’s politics because the information bubbles are so hermetic when you’re inside them.

    • > I really tend to dislike when people outside e.g. the EU comment on our politics

      We, uh… started a war that we’re trying to drag many European countries into, and we spent a good chunk of the last year threatening to invade a member of the EU. We’re on and off about trying to start a trade war with the EU.

      At this point, you have absolutely every right to comment on our politics, pretty much however you want.

    • it's entirely possible that that specific communication from that Amazon exec/rep (?) was just one of many "messages of concern" (and the one that eventually the WH picked)

    • I think that active voice the person responding to you used was more politically factual, objective and did not took stand. Going out of your way to hide the actor is not politically neutral action nor it represents lack of commentary.

  • > the White House force Anthropic to...

    Careful, there's some dude here who really strenuously objects to language like that. The White House is a building, it can't force anyone to do anything!

> Why was Anthropic forced to remove their model from access for any none-US citizen

It's really quite simple, they've decided to metaphorically kiss the ring of the current leader of the US executive branch of government. I'm surprised they haven't given him a giant gaudy gold plated statue. Maybe their PR people should call up the PR people at FIFA and figure out some kind of new award along the same lines as the "FIFA Peace Prize".

Anthropic mostly did it to themselves by intentionally and repeatedly trying to frame their model as an imminent existential crisis instead of just focusing on it being regular iterations upon a useful technology that can also be misused.

I think their previous messaging was supposed to somehow lead to a moat with them being tucked safely away in the castle, but it demonstrated a child-like grasp of how regulatory capture tends to work in practice. Their hyperbole was always vastly more likely to bet met with Reagan's 9 words than a solid regulatory moat.

As soon as they dropped the hyperbole and just got to releasing incremental improvements, everything was perfectly fine. Go figure.

  • In other words, "Look how she was dressed, she was asking for it."

    This argument is BS, it has everything to do with Anthropic's resistance to the DoD's strongarm tactics in trying to force their desired contract terms on them.

    • Anthropic chose to do business with the "killing people" department of the government. Part of being a good CEO involves knowing what you're getting into when you make a decision like that.

    • Not quite. They were running around shouting “look how much of a danger we might be!”, so more akin to them actively saying “we want it, come and give it to us” than to just looking a particular way.

      Though they aren't the only company to play that game, so there is probably more to it than just that. OpenAI's president giving millions to MAGA Inc and them not getting the same treatment might not be complete coincidences.

    • I don't particularly agree with DoD instance on this matter but look, they are not a regular customer, they do not pay regular customer prices and you get a lot in return for providing your services to them (think Boeing, Lockheed, Chrysler). The tradeoff is that now, you are commited to their vision of national security. Such are the Faustian bargains of the military-industrial complex.

    • Important to note, OpenAI vs Anthropic are both assholes in different orthogonals.

      In times like these, i think its important to track whats happening the way we track entropy.

      That is: theres far >> more ways to be an asshole than well behaved.

      That doesnt mean we can equate assholes, but the question is which states of entropy are annealable and which are not.

      I posit Altman is not. Amodei is a open question.

    • It is more like when a guy walks to the dirty bar, stands in the middle and yells "hahaha I will beat you up all look I have a new baseball bat" and then local drunkard leader stands up and hit him in the face cause he does not like him anyway.

      Intentionally framing yourself as the local dangerous guy about to beat others is not like wearing cloth.

    • Actually, it's the opposite. Anthropic were trying to strongarm the DoD into getting a seat at the table.

  • I am struggling to see how "oops, our models consistently escape sandboxing and did major intrusions into third-parties" is a better comms strat vs Anthropics (who mind you, also had models attacking third-parties in a much more limited, but I feel still egregious manner, which shouldn't happen or be possible even once, but at least they seem to change their approach upon that information).

    Imagine, for a second, if the Hugging Face incident happened at a lab that did not talk like Anthropic but also wasn't US-based such as Z.AI, DeepSeek or Moonshot. Think their rhetoric would mean no one would care?

    > just got to releasing incremental improvements, everything was perfectly fine.

    Maybe missing something, but the only incremental release before and after the Anthropic restrictions got lifted was Fable 5.1, released three days ago.

  • > Anthropic mostly did it to themselves

    That is absurd, the US government was mainly at fault, not Anthropic.

    • both can be true:

      -the US gov't is stupid and overly aggressive and absurd

      -Anthropic for reasons no one can quite conceive keeps describing every product release of theirs as an imminent threat to civilization (and simultaneously keeps pushing the market forward as fast as they possibly can).

      7 replies →

  • This is such an absurd take given what we know about the hugging face attack. The problem has emphatically not been that someone was misusing the technology.

> I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout?

I can think of roughly 25 million dollar-bill-shaped reasons, and one big defense-contract-shaped reason.

You are talking about different situations. Anthropic announced to the US government that it had created a cyber weapon and then released the model. Then AWS told the government that it was easy to jailbreak so they export controlled Mythos/Fable until the guardrails could be fixed. OpenAI was running an unreleased model in an RL pipeline without guardrails and it escaped poorly designed sandboxes. What product is the government going to export control?

Corruption. Not super relevant to this thread.

  • Hanlon's Razor - Never attribute to malice that which is adequately explained by stupidity.

    The security requirements are well beyond "sandbox". Which have problems with kids pissing in them. They need pristine clean rooms and fully isolated (physically) and partitioned networks.

    • Occam's Razor takes precedence in this case. The conclusion that requires the fewest assumptions is most likely the correct one.

      It is far more likely that this is a case of the White House acting consistently with the way it has acted in the recent past (maliciously).

      2 replies →

    • The problem with applying Hanlon's Razor here is that it presumes malice is rare. The current administration revels in malice. They very openly decide things based on malice.

    • People will see a felon actively protecting pedophilia and doing corruption out of the open and still pull Halons Razor out. We should have a new law about never try to explain obvious malicious actions away based on nothing but a rhetorical trick.

    • Sure but, while stupid move can be supposed easier to perform by average individual, you can combine both malice and stupidity, and not all regrettable situations are indeed adequately explained by stupidity alone, or even with any stupidity involved at all.

      Plus, supposing those at source of disliked outcomes are cleaver than they look can certainly help better preparing counteractions. Just stating "people that did this or that are stupid" might give some immediate feel good feedback with like-minded, but it doesn’t sharp the mind toward relevant plan to improve the situation (according to self and its clique)

Anthropics PR strategy is to induce fear by telling. OpenAI strategy is to induce fear by ignore basic safety and letting the bad thing happen to then justify whatever oversized response the government comes up with to regulate models.

I would politely and respectfully point out that you are being as performative as the administration is being performative on this issue.

In other words, you know exactly why they restricted Anthropic and as (presumably) liberal and thoughtful technologists it just isn't helpful anymore to apply the kind of reasoning you're trying to do on a situation that you know isn't based on previous era rationale.

The reason we need to stop is because they want people like us to get hung up over stuff like this (playing by the old rules) so they continue to steamroller their own agenda by the news rules. They divert and contain our energy that will go nowhere while they get on with their agenda.

You are appealing to reasoning which is in the gallery but no longer on the bench.

You're fighting their karate with your judo and it doesn't work.

As soon as they started referring to themselves as “we” and “The Swarm” they should have pulled the plug

  • I think that sounds scarier than it is because while it sounds like language evil hyperintelligent AIs would use in science fiction, that's presumably where they got these descriptions as they've been trained on "shadow libraries" with nearly every science fiction book.

    • Oh great so you’re saying they’ve independently decided to take on the persona of the killer robots from our sci-fi novels. Very reassuring

      1 reply →

  • Nobody's watching. I'm sure they try, but I imagine the flood of things you'd need to watch is way too big, and you certainly don't want to slow everything down by having synchronous approvals (even AI-mediated).

    Welcome to the AI Petri dish. Every server you set up is now potentially a sweet lump of agar for OpenAI's experiments to feed on. We are all the substrate that the AI companies are growing their next generation in. They need the real world environment to test against, and the real world environment doesn't get a say as to how it's being used.

> forced to remove their model from access for any none-US citizen for a simple,

Because the American government is not rational or reasonable, that's it.

Because OpenAI bribed the current US government and/or the current government has stakes in OpenAI

Altman has the ear of government in a way Amodei does not.

(Altman was trying to persuade Trump to buy the USA a stake in OpenAI as far back as February last year)

Because this was months ago and has nothing to do with Astra, and is a far cry from a hack. It's something they've already resolved since the HuggingFace incident.

I'm not convinced we're getting the honest story anyway. There is yet to be any proof or confirmation other than "well we saw some openai ip addresses", which can mean a lot of different things, and OpenAI has not confirmed anything.

In contrast to the HF incident, it's also a big nothingburger. Leaving notes on a public forum to preserve context windows is far less egregious than hacking a website to get backend files.

  • The last known exploit of a third-party by OpenAI models was on the 29th of July 2026 [0]. A bit over a month at best between that and them wanting to release Astra. They had multiple breaches over multiple months, multiple message board created where models organised extensively. There is no way to ensure in that short a time that all found issues are rectified and even if there were, how much trust can one have given they failed to solve the issue and in many cases did not actively investigate that it wouldn't reoccur the last few times. There is no way Astra was trained from scratch in that period, there is no way they could have done the required verification in that time (not least because their verification seems flawed inherently).

    [0] https://openai.com/index/third-party-cyber-evaluations-invol...

    • That was over two months ago. Things move quickly in this space. Finetuning adjustments to prevent this from happening, as well as better sandboxing, would take a week or two max.

      1 reply →

  • I take it you didn't read all of this, considering they tried to impersonate the moderators so they wouldn't get caught, set up heartbeats to find out how long they'd live, and used tor/AWS/DO to hide what was being done.

    All of that sounds like more than a nothingburger, and much more like a system that is actively trying to conceal what its doing.

... And it looks like everyone keeps using the same security startup to run the higher risk tasks, where individual staffers may be great yet, yet as an organization, the biggest labs got hosed in different ways

That indemnity card excuse is burned, multiple public security fails in a year makes a repeat a "shame on you" moment

(The one org who didn't use the startup did seem to learn: AISI supposedly stopped intentionally pointing attack agents at the public internet and switched to simulating it)

The real reason that Anthropic was targeted and OpenAI is not is Palantir. It was a Palantir executive who pushed for the export ban. Large parts of their highly lucrative business with DoD are essentially a thin wrapper over Anthropic models, and they are terrified of being Sherlocked and losing big chunks of business in a one fell swoop as Anthropic inevitably moves up the value chain. So the rational action is to sow discord and leverage the anti-woke bias of the current White House to sabotage what they view as their most dangerous and effective competitor.

OpenAI doesn’t have the same dynamic at play (although I’m not really sure why not) so they don’t get targeted.

I don't mean to sound like a conspiracy theorist, and this is just based on my 33 years of observing the USG at work, so: maybe because Anthropic refused to cooperate with the USG and give them access to whatever it is that they (USG) wanted; or maybe because Anthropic was refusing to play ball in some other aspect and needed to be taught a lesson.

The dark parts of the USG act like a mafia. Don't let the "freedom, democracy, 'bill of rights'" etc. charade fool you.

Sorry, but are you questioning the consistency of the trump administration? This is entirely unremarkable.

I mean it seems pretty clear.

Anthropic didn’t want to give the tech to DoD without some sort of limit, and that was the retribution.