Comment by znpy
17 days ago
> It's not so much that it can't make a decision, but that whoever allowed it to make decisions is ultimately responsible for them.
This. I agree 100%.
Computers make decisions all the time, and have been doing so for decades. But we still keep the human behind the computer accountable.
I know this has to be the case but it’s scary since most of what agents do can be a black box.
It doesn’t matter what kind of box an agent is if the people using it don’t let you know how the decisions was made.
Except now there's no longer any guarantees there's even any people you can point at. It's already often diffuse responsbilitiy. Maybe today you can still sort of get around that by pointing at business/organization owners. But soon we're going to see situations where that isn't even realistic. For example if AI agents start spinning up their own agents which work outside of the control of anyone. We're going to need some way to deal with that.
Agents run on computers, those computers have owners. We have to maintain accountability and not let people who stand to get rich from privatizing the profits but socializing the risk of rogue agents from continuing to push a narrative of autonomous super intelligence that is “too powerful” to control.
That narrative is bullshit. Intelligence is not power. The power comes from hooking these agents up to everything without proper safety controls. The fact that those safety controls don’t exist yet is not humanity’s problem, it’s the frontier labs problem, and we can’t let them wriggle out of it with an Overton window shift or demanding that the government take responsibility via regulation (of course they should but it doesn’t absolve the labs of responsibility for their own actions).
Right, but if the agents broke into the computers and are hosting themselves there without the owners knowledge, are the owners responsible? We'd say whoever originated them is responsible, but what if that can no longer be determined?
1 reply →
> Agents run on computers, those computers have owners.
and catering to them (boxes) to not accidentally start disseminating child porn is most commonly understood as a responsibility of the owner, the moment he plugs his device online.
This is also why legal action must be taken against OpenAI for the Hugging Face incident, as well as any similar incidents. Their computer, their programs, their responsibility.
> It's already often diffuse responsbilitiy.
yeah that's BS and the issue is that people actually believe that. the responsible party is whoever is running the ai agent.
Why would that need a new way? Or do you mean that no-one ever spun up anything at all (e.g., agent zero was never spun up or allowed to be spun up by anyone)?
> Except now there's no longer any guarantees there's even any people you can point at.
Really ? See VW diesel scandal. When there's a will...