Comment by slg
11 hours ago
Who do you think will be answering these questions in a future in which these AI companies visions become a reality? Because they already have a huge influence on society and that will only increase as the tech improves.
The most optimistic answer I can think of is that they will eventually agree to share their wealth under credible threats of violent revolution. That's the most optimistic outcome I see, they concede to threats of violence rather than needing actual violence.
> Who do you think will be answering these questions
Yes, this is the conversation we should probably be having! Thoughts?
Given that this is what is happening, given that we aren't going to stop physics, getting a handle on this indeed seems like one of the more important things we can do. If it will have any chance of working at all. If we don't get paperclipped.
But this is at least a much ... (forgive me) less wrong conversation to have compared to the one where everybody assumes we've already lost.
What do you think we should do? What powers do we still have where we is general humans who just want a pretty good life?
What do we do about the inherent centralization that big models seem to require, but how do we trade that off at the same time from everybody being able to synthesize the next Covid by asking their cell phone a question? What does it mean when most if not all white collar work actually can be automated?
Do we all end up playing VCs in our underwear swiping left/right on ideas our agents have to make money? Are we still competing in the market with the AIs?
Is there a class war? Is there some other weird thing? I don't know but man ... I sure would like to have those conversations.
Need work involve money? By far the most important work I do involves volunteer leadership roles above and beyond the things I do for money. Indeed, the whole edifice of modern tech rests on elements of FOSS that are, to within a rounding error, “volunteer”-built and -led. Elon’s an idol, but so is Linus.
The Biggest And Richest have Mythos. But does that diminish the utility, to me personally, of my open-weights model? Or even my humble-individual-grade Opus subscription? Relative to what I could do three years ago, computationally speaking?
Does a pretty good life have to involve controlling more material relative to members of a specific class, rather than just… deciding what’s enough, materially speaking; and stopping there?
> The most optimistic answer I can think of is that they will eventually agree to share their wealth under credible threats of violent revolution. That's the most optimistic outcome I see, they concede to threats of violence rather than needing actual violence.
Or they all figure out how to just bugger off to some Elysium-like stronghold, isolating themselves from and leaving the rest of society economically irrelevant.
At a guess, one of the unspoken reasons why there is so much interest in robot armi^H^H^H^H factory automation.