Comment by mcjiggerlog

11 years ago

Amusing and thought provoking. Does anyone have any idea how this would hold up in a court of law should some something malicious come of this repo? I would imagine not well.

IANAL, but there's no way this would hold up.

a) Software can't own property.

b) This looks like it's running from the author's own system, with the author's explicit consent. Their property, their responsibility.

c) If I launched an autonomous drone that picked its own targets, I would still be liable for its actions. Or, if I rigged a car to drive forward in a straight line, I couldn't say "but the car did it!" when it ran someone over.

  • > This looks like it's running from the author's own system, with the author's explicit consent. Their property, their responsibility.

    I have a 'solution' for that. :)

  • Does this mean that when/if we create an AI it wouldn't be able to own its creations. But its creator would own everything that the AI produces?

    • Indeed, but also if you raised a pet and then had it attack your neighbour. Humans, are the only ones with autonomous status, and even that can be disputed by other things such as mental disability or coercion.

      8 replies →

    • It might be that nobody owns anything an AI produces. If the works are created mechanically without measurable influence from a human creature, copyright simply doesn't protect them.

    • That depends on what you're talking about.

      Near term, AI will be the legal responsibility of its creator. It won't matter if it functions independently after being turned on. It's actually a very non-complex thing, and not very different from what we're already looking at. This type of AI is little different than the software programs we're already running; if someone owns it, they own it and everything it produces (absolutely no different than Google owning its crawlers).

      If you mean the assumed futuristic, independent AI that is fully conscious - well that's a very long ways into the future. A lot of things will change once a guy in a garage can spin up a new conscious life form and unleash it into the digital world. There will be an immense number of laws limiting the creation of new AI of this variety. That said, the creator will still bear responsibility for this futuristic AI's actions.

      AI will be legally split into two segments: non-sentient / non-conscious, and sentient / conscious. The latter will have at least a magnitude more regulations (in most countries) limiting who is allowed to create it, what it's allowed to be capable of, where it can go, etc.

      1 reply →

Maybe it would hold up if the bot was decentralized. For instance, it could be run on many servers around the world, administered by various people. Those servers could come to consensus in some way to define bot behavior, and could even send/receive money (e.g. Bitcoin multisig).

I don't think any court could take jurisdiction over an entity that lives in many countries. And even if one server got shut down, many more would still be active.

  • The idea that the "software owns its own code" would not hold up in any court that I can think of. Building a system that spans jurisdictions, making it difficult for a court to claim the ability to rule on it is beside that point.

    • Laws change. I'm just trying to make a statement about this exact issue.

      If an entity on the internet can't directly be controlled by anyone (kind of like Bitcoin), who is liable for its actions?

  • This might actually be possible in the near future with cryptocurrencies. Nobody "owns" a bitcoin wallet; spending the money inside is just a matter of having the private key. Assuming a service pops up to provide nonzero interest rates for holding bitcoin, you could grant the autonomous entity enough bitcoin to pay its own hosting bill indefinitely, then erase your copy of the wallet key and any privileged access you have to the server.

    As for the actual software running the autonomous entity, all you have to do is provide an API so that the hosting providers du jour can bid on providing hosting service. Since the software uses nearly zero CPU or bandwidth, and the entity would be willing to pay above-market prices for its survival, hosting providers will be incentivized in perpetuity to register themselves and collect basically free money from the entity.

    Irrational hosting providers might try to kill it, so you'd need some level of redundancy. Also, you'd want to require a TPM and a trusted computing platform to prevent recovery of the wallet key.

    Anyway, that's how you'd create immortal software.

    • > Also, you'd want to require a TPM and a trusted computing platform to prevent recovery of the wallet key.

      This is the part where you're going to run into problems. If the software can access the wallet key, then so can the hosting provider. If it can't, then how is it going to spend money? (Hint: look at the operations that a TPM actually provides; do they actually map in a useful way to things a Bitcoin agent would actually need to do?)

      3 replies →

Not at all. Software doesn't qualify for personhood in the same way that animals don't - perhaps you remember that case last year of monkey who took photographs of himself with a wildlife photographer's camera. The photographer tried to claim copyright, which was rejected as he was clearly not the author of the photographs, but since the monkey can't have a copyright interest either the picture is considered to be in the public domain for copyright purposes.

http://arstechnica.com/tech-policy/2014/08/monkeys-selfie-ca...

How do you declare yourself exempt from laws -- within a legal framework? Who is going to enforce the license?

IANAL but assuming that the author making this license was in US, it is totally void. It could lead to a court having to formally state that a software is not a legal entity, which would be interesting, but I think the result is clear that this precise software would not be recognized as one.

You can't transfer ownership of anything to a non-existent entity. My guess would be that such a transfer would be void but it may be possible that a court decides instead that this means a transfer to public domain.

Waving away the responsibility of other people does not work either. You can't claim that your car is responsible of the accidents you drive it into. Likewise, it is unlikely that any court dismisses the responsibility of the first person that will turn this into a malware.

Contracts are constructs that exist only within the confines of a legal system. This cannot even hope to function without human laws.