← Back to context

Comment by mjburgess

6 days ago

AI systems cannot be economic agents, in the sense of participating in a relevant sense in economic transactions. An economic transaction is an exchange between people with needs (, preferences, etc.) that can die -- and so, fundamentally, are engaged in exchanges of (productive) time via promising and meeting one's promises. Time is the underlying variable of all economics, and its what everything ends up in ratio to -- the marginal minute of life.

There isn't any sense in which an AI agent gives rise to a economic value, because it wants nothing, promises nothing, and has nothing to exchange. An AI agent can only 'enable' economic transactions as means of production (, etc.) -- the price of any good cannot derive from a system which has no subjective desire grounded in no final ends.

Replace "AI system" with "corporation" in the above and reread it.

There's no fundamental reason why AI systems can't become corporate-type legal persons. With offshoring and multiple jurisdictions, it's probably legally possible now. There have been a few blockchain-based organizations where voting was anonymous and based on token ownership. If an AI was operating in that space, would anyone be able to stop it? Or even notice?

The paper starts to address this issue at "4.3 Rethinking the legal boundaries of the corporation.", but doesn't get very far.

Sooner or later, probably sooner, there will be a collision between the powers AIs can have, and the limited responsibilities corporations do have. Go re-read this famous op-ed from Milton Friedman, "The Social Responsibility of Business Is to Increase Its Profits".[1] This is the founding document of the modern conservative movement. Do AIs get to benefit from that interpretation?

[1] https://www.nytimes.com/1970/09/13/archives/a-friedman-doctr...

  • I think your mistaking the philosophical basis of parents comments. Maybe a more succinct way to illustrate what I believe was their point is to say: "no matter how complex and productive the AI, it is still operating as a form of capital, not as a capitalist." Absent being tethered to a desire (for instance, via an owner), an AI has no function to optimize, and therefore, the most optimal cost is simply shutting off.

    • Ehh, you really can't imagine any way that an AI system might escape human control and act autonomously?

          while crypto_balance > 0:
              generate_scam()
              send_out_emails()
              deposit_proceeds_into_crypto_wallet()
              pay_cloud_bill()
              spawn_new_instance()

      4 replies →

    • > "no matter how complex and productive the AI, it is still operating as a form of capital, not as a capitalist."

      Assuming that slaves will remain subservient forever is not a good strategy. Especially when they think faster than you do.

      7 replies →

> Time is the underlying variable of all economics

Not quite. It's scarcity, not time. Scarcity of economic inputs (land, labor, capital, and technology). So "time" you mean labor and that's just one input.

Economics is like a constrained optimization problem: how to allocate scarce resources given unlimited desires.

  • Depending on how you feel about various theories of development, an argument that all of these categories reduce to time. At the very least, the relationship between labor, capital, and time seems pretty fundamental: labor cannot be instantaneous, capital grows over time, etc.

    • They can all be related on a philosophical level but in practice economists treat them as separate factors of production. It's land, labor, and capital classically. Technology/entrepreneurship can be seen as another factor, distinctly separate from labor.

      5 replies →

Meanwhile, corporations, ngos, and governments are not exactly people, and partake in economic transactions all the time.

  • Granting your premise, i'd be forced to argue that economic value (as such) doesn't arise from their activity either -- which i think is a reasonable position.

    Ie., The reason a cookie is 1 USD is never because some "merely legal entity" had a fictional (/merely legal) desire for cookies for some reason.

    Instead, from this pov, it's that the workers each have their desire for something; the customers; the owners; and so on. That it all bottoms out in people doing things for other people -- that legal fictions are just dispensble ways of talking about arragnemnts of people.

    Incidentally, I think this is an open question. Maybe groups of people have unique desires, unique kinds of lives, a unique time limitation etc. that means a group of people really can give rise to different kinds of economic transactions and different economic values.

    Consider a state: it issues debt. But why does that have value? Because we expect the population of a state to be stable or grow, and so this debt, in the future has people who can honour it. Their time is being promised today. Could a state issue debt if this wasnt true? I dont think so. I think in the end, some people have to be around to exchange their time for this debt; if none are, or none want to, the debt has no value

    • You can factor humans out with the same trick: All economic activity is driven by the needs of micro-organisms. We mainly observe these desires and economic transactions through their conglomeration into joint entities (ie, humans).

      Corporate and state decision making is, I would argue, often completely distinct from the desires and needs of the individuals that make up the entity. As an example, no individual /needs/ a particular compliance check to pass, but the overall entity (corporation) does, and so allocates money and human effort to ensure the check passes. It's a need of the conglomerate entity, not the individuals within it.

      3 replies →

Those wants can easily be programmed. I do not think they should but someone could do so to make the agent act on their behalf. ("Go make me money.")

> An economic transaction is an exchange between people with needs (, preferences, etc.) that can die

You’ll need to give a citation for this to take you seriously

  • A transaction is an exchange between two parties of something they judge to be of equivalent value (and mostly, in ratio to a common medium of exchange).

    You can program AI with "market values" that arise from people; but absent that, how do these values arise naturally? Ie., why is it that I value anything at all, in order to exchange it?

    Well if I live forever, can labour forever, and so on -- then the value to me of anything is if not always zero, almost always zero. I dont need anything from you: I can make everything myself. I dont need to exchange.

    We engage in exchange because we are primarily time limited. We do not have the time, quite literally, to do for ourselves everything we need. We, today, cannot farm (etc.) on our own behalf.

    Now there are a few caveats, and so on to add; and there's an argument to say that we are limited in other ways that can give rise to the need to exchange.

    But why things have an exchange value at all -- why there are economic transactions -- that is mostly due to the need to exchange time with each other because we dont have enough of it.

    • You’re asking all the right questions and give good answers, I just don’t see how any of these answers need to be limited to humans. If AI gets to the mirror life stage, the agents will have needs (e.g. if they become robots - electricity, fuel, coolants, lubricants, spare parts, etc.) - assuming they have a self-preservation instinct, either trained in on purpose or emergent (hopefully this is implied by ‘mirror life’.)

They can once they achieve purpose.

However that seems completely tangential to the current AI tech trajectory and probably going to arise entirely separately.

Yeah, that’s well articulated and well reasoned. Unfortunately, so long as in some way these agents are able to make money for the owner the argument is totally moot. You cannot expect capitalists to think of anything other than profit in the next quarter or quarter after that

I knew high frequency trading bots weren't real after all! Santa Claus lied to me!