← Back to context

Comment by comnetxr

4 hours ago

I think the better analogy is an insane nuclear power plant manager deciding it wants to buy pens to use as neutron-flux regulator rods — because after all, a pen is functionally a pencil and a pencil is made of graphite.

Then the pen manufacturer hears about this and says “Our pens are not made of graphite and are not suitable to be used in nuclear reactors”, to which the reactor owner says “it’s fine, they fit in the graphite rod holes, and we’re just using until the next generation of pens come out which will do an even better job”, and then the pen manufacturer says “I’m not going to sell you any pens until you agree that they will be used only writing.”

The previous power plant manager had, of course, already signed a contract agreeing to those terms; the power plant is subsequently under new management and upset about being bound by this contract, so they designate that none of their suppliers of parts and fuel are allowed to have any commercial dealings with the pen manufacturer or use these pens for any purpose, even writing.

  • And why would the manager ban the manufacturers pens even for writing, except out of spite to punish the manufacturer? And coming back to the real case, is the supply chain risk designation supposed to be a punishment or only there to actually protect the supply chain?

That analogy still makes this sound like a textbook designation. In that situation the pen manufacturer is expected to sell pens without a theory of what will happen next. The person who buys a pen might use it to kill someone or commit horrific legal/moral crimes and that has nothing at all to do with the pen manufacturer.

I can see how I might reasonably refuse to deal with that pen manufacturer. The pen manufacturer is unreasonably pushy and they're going to be massive trouble to deal with because they're all up in my business in a paranoid way and disrupting my use of their product. Companies have made my never-again list for far smaller slights.

This is the most accurate parallel as far as I can tell. I've not seen any evidence that Anthropic deliberately built automated systems or escape hatches that literally prevent the US Government from using Claude to do these things. Other than the basic AI Safety mechanisms in place for everyone/general use. It's almost the reverse, where they explicitly don't want to strip away guardrails that say things like "don't kill people".

The intent and framing matters a lot here. Refusal to remove safety features is a LOT different than deliberately building mechanisms to sabotage would-be operations.

  • It doesn't seem like you understand what a supply chain risk designation is for.

    It's to ensure that companies that the DoW relies on don't build on top of a product that isn't fit for DoW work.

    You seem to be agreeing with this designation in a way. The DoW essentially said "Pen company won't let us use their pens as neutron-flux regulator rods, so anyone building power plants for us isn't allowed to use these pens as neutron-flux regulator rods".

    What is the problem you have with that?

    • They've essentially said "pen company won't let us use their pens as neutron flux regulator rods, so anyone building power plants for us isn't allowed to use these pens as pens"

      (and yeah, there might be a completely legitimate reason to stop your subcontractors from using HuaweiSpyPens, but determining that ACME Pens is just as dangerous because they refused your neutron flux regulator order looks like a punitive measure, not practical risk reduction)

    • So the DoW should have the ability to perform mass surveillance on American citizens?

      Mind you, that is not the DoW’s charter. How would a restriction on that be “unfit” as you say?

      The DoW is perfectly within their rights not to purchase anthropic products. That’s different than labeling them a supply chain risk.

      6 replies →