Comment by peri-cl
12 hours ago
There are zero laws against the design, manufacture, sale, or possession of cars with spinning blades and/or flamethrowers.
Such laws attach to the human operators of such cars, if they recklessly endanger others by driving them on shared, public roads.
But they're perfectly legal to own (and operate off-road). And, there's no technical barrier stopping people from illegally driving them on public roads: just fear of laws.
(There's entire subcultures of people who modify cars to do insanely dangerous things, on private race tracks. Perfectly legal).
If we were to apply Amodei's safety standard to cars—do they have the theoretical risk of killing over 50 people—well, cars empirically kill tens of thousands of people in the US annually, so we'd have to categorically ban them. That standard is bad-faith and absurd.
So we just make the regulation such that it kicks in on machines connected to the public web?
No. Half the point of LLM's is having them research topics on the internet as your agent. It's totally harmless in the usual (tool-based search) workflow.
(Would we also need a real ID to operate curl(1)?)
Regulations should attach only at the point humans willfully or recklessly cause their agents to commit crimes.
But keeping with the analogy, a car manufacturer would be liable for a faulty design that caused wrecks, no? It doesn't need to be willful by the user.
1 reply →