← Back to context

Comment by petcat

7 hours ago

I still don't fully understand what this was about. It sounds like the DoD said they wanted unrestricted access to Anthropic's models, Anthropic refused, so the Pentagon declared that they wouldn't use them at all.

Isn't this basically what Anthropic wanted?

As I understand it cane down to one point: Anthropic wanted the ability to review actions that would have an effect on human life.

Which sounds sensible on the surface, until you realize that all military organizations have extensive experience with that exact question, and have spent centuries refining their practices. Deferring that to a private company is actually a major regression and a concerning role to pass on to the public regardless.

FWIW I am not pro military, but it's a prominent part of human culture and not going away anytime soon. I do understand the nature of professions, however, and only one of these groups has made the interpretation of this question their specialization.

  • Militaries have a lot of experience, and an exceptionally poor track record.

    I don’t remember the last war that didn’t have credible evidence of war crimes occurring. Were bombing civilian infrastructure in Iran, Iraq had Abu Ghraib among all the Collateral Damage stuff, the Highway of Death in the Gulf was probably a war crime, Vietnam had My Lai, WWII was the advent of carpet bombing civilian infrastructure. I can’t think of any for Korea, but I also know very little so that doesn’t say much.

    We still haven’t charged anyone for the second strike on that fishing boat in South America, and I haven’t heard a single rationale for why that’s not a war crime other than “fog of war”.

    The US doesn’t even really have a meaningful system for finding and prosecuting these, because we aren’t signatories for the ICC and have a bill saying we’ll invade if they charge one of our service members with a war crime. We aren’t basically the furthest thing from having any experience prosecuting war crimes. I can probably count on my fingers the number of cases we’ve tried. We rarely charge our own service members, and we usually kill foreign combatants rather than capture and charge them.

    • A poor track record compared to who? The Romans?

      War includes death by design. The trajectory is trending toward less unjustified death.

  • >As I understand it cane down to one point: Anthropic wanted the ability to review actions that would have an effect on human life.

    This is not at all what happened. The existing contract that Anthropic had with the government had two red lines: No autonomous weapons (i.e., do not build Skynet with Claude), and no mass domestic surveillance.

    Anthropic did not, and does not want, any case-by-case veto power over the US Military's use of their AI models. The red lines were negotiated ahead of time.

  • Yes, that's exactly why they used AI to blow up a school murdering a load of kids.

    That kind of extensive experience.

    Anthropic did the morally right thing and are being punished for it. The case in point justifies their position.

    As they say, no good deed goes unpunished.

  • You raise an interesting point. Although wouldn’t Anthropic be the best experts on when a model would be most applicable or likely to falter?

    I guess my opinion would really depend on the exact wording and details of the arrangement. Lots of people jumping in with strong stances based on pretty limited details.

    • On faltering: the US Military already has rules around the use of automated systems for this type decision making. This is not a new concept to them by any means, and currently it always involves a human decision.

      2 replies →

  • > As I understand it cane down to one point: Anthropic wanted the ability to review actions that would have an effect on human life.

    This is false. Anthropic wanted assurance that its technology would not be used for fully autonomous weapons or domestic mass surveillance.

    • > [Anthropic] would not permit its technology to power fully autonomous weapons without human oversight over targeting and firing decisions. Defense Secretary Pete Hegseth argued that the Pentagon should have unrestricted access to AI systems for “any lawful purpose” and that a private contractor should not be permitted to dictate how the military can use its technology.

      It's about them maintaining an interpretation of law at all.

      Simpletons read that as: "The DOW wants to kill people with AI."

      https://www.pearlcohen.com/anthropic-sues-department-of-defe...

      4 replies →

They also effectively said that military contractors and their subcontractors cannot use Anthropic - that's a significant part of the economy. I mean technically, they can use Anthropic for non-military work. But in practice, they will choose not use it at all, since it's a better approach to show compliance.

And crucially, the DoD, through the normal procurement process, agreed to Anthropic’s terms and made the purchase. Much later, the Secretary of Defense threw a political fit and tried to change the terms.

Evidentially not - Anthropic want to do business with the US military, but on their own terms, telling the military what they can and cannot use it for.

  • Is that a problem? Are there any special rules (genuinely curious) that allow the military to hijack the management of a private firm?

    • AFAIK it wasn't in play here, but yes, we do allow that to a degree via the Defense Production Act

    • I think the answer is the military finds another vendor willing to deal, or move it in house.

      It's not like Anthropic will be nationalized any more than the bankrupted auto companies of 2008.

      4 replies →

    • It’s not a problem. But it’s also not a problem for the DOD to decide that it doesn’t want to use anthropic or have its suppliers use anthropic for DOD matters. The DOD didn’t ban private citizens from using Anthropic. You can sell in your own terms but the DOD can also buy in its own terms.

      4 replies →

    • Yeah, for national security being the biggest one. Also Congress can do whatever they want if they desired. If Congress mandated that all social media companies have to become workplace democracies, that's totally fine and legal.

      We've forgotten what it means to run a society, we're allowed to change rules how we see fit whenever we want to. Only the elites exercise this power, but people have it too.

      6 replies →

    • "Are there any special rules"

      Yes. Paragraph #1, sentence #1 of the US Constitution: "provide for the common defence[sic]". This is further elaborated upon in other original Constitution articles and subsequent amendments.

      From that, we derive a long, storied history of things, among the more recent of which, and the operative matter here, is the Defense Production Act circa 1950.

      The US is fundamentally based on the obligation of mutual military defense, and delegates the authority to call military balls and strikes, such as who will and will not be permitted to contract with the US military, exclusively to POTUS. Anthropic et al. are way out of their depth when they imagine their "terms and conditions" imbue them with some sort of military veto power in the US. Trump's action here, given his nature, is actually moderate: he could take this much further if he wishes.

  • Every private citizen or corporation gets to do business (or not) with the military on their own terms. This is the difference between totalitarianism and a free country.

    Anthropic’s position is also known as “having terms of service”.

    To be clear the existing, signed ToS terms that Trump balked at were:

    1. No mass surveillance of US civilians - illegal but we have all read the Snowden papers.

    2. Fully unmanned kill chains on autonomous weapons - Anthropic have even stated they will support this eventually, they just didn’t think their models were ready and didn’t want the obvious, inevitable blowback.

    The DoD is within its rights to cancel the contract if it doesn’t like the terms that it previously signed.

    • The concern, I think, in its most generous terms, is that they can't buy Anthropic's service the way the could, say, a wrench, because Anthropic can decide at any point to disable the military's ability (even transitively, through other vendors) to use their models if they determined that they do not like what the military is doing with that or if it violates their interpretation of the terms of service.

      This seems like a definitional supply chain risk.

      6 replies →

You're skipping the supply chain risk designation, which is an extraordinary and punitive measure. Without that part, you'd be correct that this is a nothingburger. "Government decides to not renew contract with corporation X and goes with Y instead" is not headline news.

No it's not. Anthropic didn't want an AI to make battlefield decision on who gets killed because it's too unreliable. That doesn't mean they don't want AI used in the military supply chain.

And it also doesn't mean that Anthropic is a supply chain risk merely for not wanting AI to be the active decision maker in live or death situations in war.

And Anthropic's objection was recently confirmed: the US military blew up a school in Iran due to an AI error, and killed more than a hundred kids.

The Pentagon is trying to bully contractors into also not using Anthropic's models

No. This also means that no companies that work with th DoD can use anthropic models for any purpose.

  • > This also means that no companies that work with th DoD can use anthropic models for any purpose.

    No, it does not mean that. I don't know why people have been making this claim. If you work for a company, let's call it X, and your work is not DOD related, let's say you work on a social media service, then X has no reason (from this designation) to prevent you from using Anthropic, it will not impact their defense contracts at all.

    • People have been making this claim because the Secretary of Defense personally issued a statement demanding that "no contractor, supplier, or partner that does business with the United States military may conduct any commercial activity with Anthropic". We're not going to play this absurd game where government officials issue fascist instructions and we all pretend they said something more reasonable instead.

      9 replies →

  • Dario wanted to sell a $200 million chat bot to the US military and also dictate how it could be used. The government said no. And because of that Claude also cannot be deployed to the GenAI.mil AI infrastructure. This means that any sensitive work for the DoD that uses Claude will go through Anthropic's infrastructure, not the US military-hosted backend.

    So yes obviously defense contractors are forbidden to use it.

Anthropic isn’t aligned with MAGA political ideology so they found an excuse to abuse power against them, more or less. The excuse was because Anthropic prohibits the use of their models for autonomous killing without a human in the loop they were declared a threat to national security on par with Iran or North Korea from a supply chain perspective in the military. OpenAI then rushed in and volunteered to build the slaughterbots ASAP, likely specially tuned to whomever Trump has taken a disliking to in his ambien stupors. Welcome to the future!

[flagged]

  • How is it delusion? If they don't want to work with certain types of government contracts they have the right to state so. Its just thuggery from Trump.

  • Especially since Anthropic themselves have been literally saying that AI might destroy humanity. Why is it a surprise when people take them at their word and designate them a risk to critical infrastructure?

    Side note, the Anthropic bots are astroturfing the comments.

    • >Side note, the Anthropic bots are astroturfing the comments.

      if this is more than "people i disagree with are commenting", you should be messaging hn@ycombinator.com rather than writing it as a side note in your comment.

      5 replies →