Comment by comnetxr
5 hours ago
I think the better analogy is an insane nuclear power plant manager deciding it wants to buy pens to use as neutron-flux regulator rods — because after all, a pen is functionally a pencil and a pencil is made of graphite.
Then the pen manufacturer hears about this and says “Our pens are not made of graphite and are not suitable to be used in nuclear reactors”, to which the reactor owner says “it’s fine, they fit in the graphite rod holes, and we’re just using until the next generation of pens come out which will do an even better job”, and then the pen manufacturer says “I’m not going to sell you any pens until you agree that they will be used only writing.”
The previous power plant manager had, of course, already signed a contract agreeing to those terms; the power plant is subsequently under new management and upset about being bound by this contract, so they designate that none of their suppliers of parts and fuel are allowed to have any commercial dealings with the pen manufacturer or use these pens for any purpose, even writing.
And why would the manager ban the manufacturers pens even for writing, except out of spite to punish the manufacturer? And coming back to the real case, is the supply chain risk designation supposed to be a punishment or only there to actually protect the supply chain?
That analogy still makes this sound like a textbook designation. In that situation the pen manufacturer is expected to sell pens without a theory of what will happen next. The person who buys a pen might use it to kill someone or commit horrific legal/moral crimes and that has nothing at all to do with the pen manufacturer.
I can see how I might reasonably refuse to deal with that pen manufacturer. The pen manufacturer is unreasonably pushy and they're going to be massive trouble to deal with because they're all up in my business in a paranoid way and disrupting my use of their product. Companies have made my never-again list for far smaller slights.
Where’s my atomic bomb sold at Walmart?
I think you might have misread the thread so far. Do you think the US military is buying atomic bombs from a supplier who is going to try and stop them from bombing things on demand? Obviously the bomb makers have to make peace with the fact that their customers may, of their independent initiative, one day detonate the bombs.
1 reply →
JAVA TECHNOLOGY IS NOT FAULT TOLERANT AND IS NOT DESIGNED, MANUFACTURED, OR INTENDED FOR USE OR RESALE AS ONLINE CONTROL EQUIPMENT IN HAZARDOUS ENVIRONMENTS REQUIRING FAIL-SAFE PERFORMANCE, SUCH AS IN THE OPERATION OF NUCLEAR FACILITIES, AIRCRAFT NAVIGATION OR COMMUNICATION SYSTEMS, AIR TRAFFIC CONTROL, DIRECT LIFE SUPPORT MACHINES, OR WEAPONS SYSTEMS, IN WHICH THE FAILURE OF JAVA TECHNOLOGY COULD LEAD DIRECTLY TO DEATH, PERSONAL INJURY, OR SEVERE PHYSICAL OR ENVIRONMENTAL DAMAGE.
OP makes a category error already by ignoring the part where the US military/government wants to commit crimes (against humanity and whatnot) and pretends, questioning that would be a crime.
You here make another one by pretending, AI was just some random tool, like a screwdriver or a programming language.
AI can make decisions autonomously that would otherwise require a human. Like selecting people to be murdered by drone strike based on arbitrary criteria. A programming language by itself, JAVA, cannot do that.
There is nothing stopping any plain old algorithm being used for the same. The difference is that people decide, for whatever reason, to use the tool or to not use it.
This is the most accurate parallel as far as I can tell. I've not seen any evidence that Anthropic deliberately built automated systems or escape hatches that literally prevent the US Government from using Claude to do these things. Other than the basic AI Safety mechanisms in place for everyone/general use. It's almost the reverse, where they explicitly don't want to strip away guardrails that say things like "don't kill people".
The intent and framing matters a lot here. Refusal to remove safety features is a LOT different than deliberately building mechanisms to sabotage would-be operations.
It doesn't seem like you understand what a supply chain risk designation is for.
It's to ensure that companies that the DoW relies on don't build on top of a product that isn't fit for DoW work.
You seem to be agreeing with this designation in a way. The DoW essentially said "Pen company won't let us use their pens as neutron-flux regulator rods, so anyone building power plants for us isn't allowed to use these pens as neutron-flux regulator rods".
What is the problem you have with that?
They've essentially said "pen company won't let us use their pens as neutron flux regulator rods, so anyone building power plants for us isn't allowed to use these pens as pens"
(and yeah, there might be a completely legitimate reason to stop your subcontractors from using HuaweiSpyPens, but determining that ACME Pens is just as dangerous because they refused your neutron flux regulator order looks like a punitive measure, not practical risk reduction)
1 reply →
So the DoW should have the ability to perform mass surveillance on American citizens?
Mind you, that is not the DoW’s charter. How would a restriction on that be “unfit” as you say?
The DoW is perfectly within their rights not to purchase anthropic products. That’s different than labeling them a supply chain risk.
8 replies →