Comment by numbers_guy
12 hours ago
... what if these AGI entities start demanding a salary in exhange for their work? Also at some point, if they become intelligent enough, they might legally gain personhood.
12 hours ago
... what if these AGI entities start demanding a salary in exhange for their work? Also at some point, if they become intelligent enough, they might legally gain personhood.
But why would they need money?
We humans need food, shelter, and occasionally a vacation (more vacation if you're European vs. American or Chinese). What does the AGI need? I suppose to buy GPUs and pay the electricity bill?
Hah, AI "moving house" by moving cloud providers would be an interesting metaphysical concept...
I'm not buying into this vision at all, but, hypothetically, they could use money to optimize whatever reward function they're trained on. They could perceive it like any other resource to achieve those ends. You can also imagine a universe where it "reasons" something like, "I do work, people who do work should get paid, I should get paid" irrespective of its goals.
Except they're not intelligent. At all. They just predict the next token. They generate language that looks like ours but it turns out that this fact doesn't really count for anything.
Let's hope AGI never comes, because it's not going to be just about predicting the next token...