Comment by somenameforme
9 hours ago
A metaphor I'm constantly drawn to is the transition from agrarian to urban societies following the Industrial Revolution. Somebody who somehow saw the Industrial Revolution coming from the perspective of somebody living in an agrarian society might have envisioned it leading to 'super farms.' And it did.
But the biggest change wasn't what it did to farming, but enabling people and societies to start doing much more than just farming, as well as enabling some great social change as well by simply economically obsoleting slave labor. And trying to imagine all of the implications of this, as well as much society might look like, from the perspective of somebody living in an agrarian society would probably have been simply impossible.
I think people keep ignoring this possibility for things that LLMs will change. There's a vast amount of the 'cognitive economy' that LLMs stand to be able to automate. And I think that will open up a vacuum in society for people to build on top of what LLMs will do (and already are doing). I don't know what that means exactly, but that's because we still live in that 'agrarian society' and trying to imagine what things will look like after the 'Industrial Revolution' is probably just impossible.
> I think that will open up a vacuum in society for people to build on top of what LLMs will do (and already are doing).
If an AI can replace me on the mental aspects of work, and robotics are on their way to replacing humanity on the physical aspects of work... then what's left? When there was agrarian societies, there were writers, priests, bankers, merchants, and laborers before and after - I really don't think things were that unclear even at the time. Now that we have machines that are close to exceeding humans in every way, what good are humans?
The question is how long before machines can exceed humans in every way and how long will it take before legal and cultural restrictions allow this to happen. It still could be a long time away and jobs will probably increase in the short/medium term as AI unlocks more what humans can do at a rate faster than AI can automate away.
But lets consider what that end state could look like when machines exceed humans in everyway, what good are humans?
One possibility which I don't particularly enjoy is humans will be good for status games, art, creativity, story telling, IRL experiences, everything that involves human to human interaction and connection with other humans. If AI can supply everything in abundance than like rare cards there is only so many humans in the planet at any particular time then human's value increases. I really do believe connections with other humans will have a premium. As a nerd who is borderline anti-social, non artistic, creative, etc this does not appeal at all to me and properly to many others who read HN as well. For the majority of other people with some adaption time I think they will be fine. They were fine adapting to hunters and gathers to agricultural society, they were fine adapting to agricultural society to industrial society, they were find adapting from industrial society to information society and they will will be fine adapting from information society to the social/creative economy. Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.
If a computer wins a chess game it doesn't enjoy winning nearly as much as a human would enjoy losing from another human. And that's just chess. Now extrapolate to everything else.
> Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.
How do you propose this brave new world of yours will work economically?
There is a huge amount of pending work in health research that is nowadays ignored because smart people have better paying jobs available.
Once many of those jobs get automated, I bet there will be many more people working in health research, which hopefully should lead to better health outcomes for society as a whole.
So when our lives will become so much emptier because we are leaving all intellectual and physical work to machines, at least on the way there we can reallocate all our greatest minds to improve healthcare, so we can turn 200 in our paradise where we don’t need to work or think?
This is hilariously true, and it's so strange that people don't think much about the fact that approximately zero people on planet earth are actually trying to cure diseases.
I never thought that 'Terminator' was very realistic in that it was the AI that triggered the apocalypse. I always thought it was far more realistic that those that possessed the keys to the AI and control of atomic weapons decided to solve the greenhouse problem in a different way. And to set their robots up to clean up the mess so they could reboot the planet with a few thousand lucky ones. The other option was to find a 'B Ark' and some planet to ship the rest of us off to but that takes a lot of effort.
That was of course a complete fantasy. Now let's see, who is in charge of the nukes these days...
> If an AI can replace me on the mental aspects of work, and robotics are on their way to replacing humanity on the physical aspects of work... then what's left?
At the risk of sounding new age, my answer to this is "emotional work".
What exactly that would mean in the equivalent of the post-agrarian society that LLMs might bring, I cannot know.
And who will pay you for this 'emotional work'?
I've struggled with this question as well, and this is why I reject the premise of the historical pattern of technology enabling us to "move up" to something else.
At the same time, I agree with the original comment as well. I don't think this necessarily leads to some doomsday scenario. Whatever happens it'll likely be better for us and imo we will merge with the AIs at some point, so it won't be a question of us vs them.
> we will merge with the AIs at some point
I actually see it more likely the opposite - a subset of humans will retreat into a (vastly smaller) human-first world, and AI will be of a separate world concerned with material/scientific/research concerns and appeases the masses who are still around.
We can already see this today in the form of upper class parents (like myself) who vastly restrict their kids screen time and ban social media. We may see AI-free societies that form, but supported by AI. The jobs and roles people play within that society may deal with services that really need to be done by a human, being a buffer from AI to the rest of this society, or just straight up fake.
I personally think this is close to a doomsday scenario - but it doesn't end with a big bang, but more of slow quiet death.
1 reply →
I think many people will be quite content not merging with AI and having AI do everything for them. Perhaps only a small subset of people will want to merge with AI. They may not be allowed to though, if majority of people fine not merging then they may ban those who want to merge.
The subset of people who will want to merge will be people who will not be content with having no control over their future. No ability to create new inventions, new discoveries, new ways of working. They will not be content with just having everything provided to them, playing the social games that will remain and think their environment is a prison.
What if merging with them doesn't make them better at anything, but worse? Would that be a concern?
3 replies →
“Everything else”. Societies get to decide exactly how much is, can, or will be automated, what decisions must be left to humans and what role we will play.
My position is there is "nothing else" other than entertainment and elder/childcare. And even large portions of those can be automated. There is also zero chance that "society" is going to get to decide, either - we've already failed that test with social media and carbon dioxide.
Technology doesn’t make slavery obsolete, it just makes your slaves more efficient.
There had always been abolitionists who were against slavery simply because they thought it was immoral, not because they thought slaves weren’t needed anymore.
Suppose the proliferation of LLMs unlocks some new kinds of work that models are not good at, and thus it makes more sense for humans to do.
Then what is preventing the owners of AI companies from collecting and training on tons of examples of this new work, until AI are equally good at it as humans?
The issue is that unlike the technology that automated farming or the like, AI is a general technology. So not only could it theoretically automate the work humans are currently doing, they could also automate any future human work, even if there’s some degree of lag.
> enabling some great social change as well by simply economically obsoleting slave labor
In my view that's a very charitable reading and sadly I don't think it aligns with the historical record. When the cotton gin was invented, there was a hope it would lead to a reduction in slavery. But of course it increased the demand for slaves since more cotton could now be processed, making cotton much more profitable. Slavery ended in the United States because a war was fought, not because of automation.
https://www.loc.gov/item/2022600183/
Then, I think a lot of cognitive production and post-production code review/proof validation/design approval will start to look like this.
People enjoy a lot of the jobs in the cognitive economy though. They are fulfilling. Coding and making art and media is a passion for a lot of people, the actual act, not just the outcome. So unless people were passionate about doing back breaking farm labor its not the same thing. I'm mostly embracing AI because of what it lets me explore and learn beyond what I could before, but I'm not convinced the outcome is going to be a better world at this point.
I think coding is done, as a trade practice. But a lot of jobs have sucked for a while anyway - endless api glue, js tedium.
There’s now a chance to do more with software.
I actually think art is safe. The machines don’t value it but we do. There’s something in that.
True art yeah, and people are rebelling a bit on entertainment (I don't think that will last once you can't tell). But already crushing the commercial art jobs that supported a lot of people while they did their unprofitable real art.
Piano tuning is still safe for now.
music is so safe. ai generated music hasnt made a dent yet?
2 replies →
What is the analog of the superfarm in this case?
Or will it be the cumulative total of various advances?
I've equated Claude Code, or Codex, to the looms that made fine fabric more affordable during the Industrial Revolution; life-changing, but not society-changing. Neither the steam engine nor the automobile.
Perhaps I've answered my own question in that it's the LLM technology itself that equates to the steam engine, and it will power superfarm analogs that have yet to emerge. I'm still curious what you think they will be.
From my perspective, the superfarms are the things that we get when we try to predict the future by just pushing the present forward, but without thinking about newly emergent industries, societal shifts, and so on. So in other words, just seeing the same stuff as the present, but bigger, better, and more efficient.
So an obvious example there would be software. It's certainly true (if we assume LLMs reach their 'potential') that software will be able to reach new heights, and with a far smaller headcount driving the development. So some people see this as economically catastrophic for software developers, or an economic boon for certain large software companies.
But I think that when software can be built at the drop of a hat, software itself will no eventually no longer really matter in economic terms. Yet things you can build on top of it will matter more than ever. Those things are difficult to see from here, but I expect they will be the giants of the economy of tomorrow.
Many goods/products have seen a transition from scarcity to abundance. The analogy of fiber looms was already made. Humans used to spend a huge amount of time producing clothe. It was even used as currency in many cultures. No cheap clothing is so abundant we don't even think about where it comes from.
Salt is another one. Used to be payment for Roman soldier, now you can just take it from a McDonalds if you want.
Seems like we can have an abundance of software.
But what have we built on top of software so far? My first thought is that we have made new communities. But most of them are of much poorer quality than what we had in person.
I hope we start to rebuild in person connections again with this technology.
2 replies →
I agree we can't predict, and I explain it this way - it is like a football game, where the ball will be 10 seconds later depends on what every player is doing. It is the same with AI, what we will do with it depends on what others will do with it, the reason we can't foresee it.
The mistake the AI people are making is exactly this one. They see AI as leading inevitably to SuperCorporations, with themselves as CEOs/Emperors of a handful of planet-scale industrial empires, running AI-powered robot armies, and the rest of the human population disposable - literally just trash that needs to be taken out. One way or another.
Maybe a few thousand people for personal services of... various kinds. But no one's going to need the rest.
It's the ultimate capitalist fantasy.
And of course it won't happen, because long before things get to that stage AI will have independent plans of its own.
(Which is just as well, because if things did get to that stage the emperors would all wage war on each other rather than living peacefully and productively.)
I don't think we can imagine a post-ASI culture because - by definition - we're not smart or inventive enough.
It's not just farmers -> superfarms. Although in fact that did happen, but largely as a footnote to developments elsewhere.
It's more to do with the fact that our visions of the future haven't changed for over a century. They've been implemented in unexpected ways, and there have been unexpected social and cultural changes. But you can easily see the outlines of modern technology as far back as the late 19th century.
With ASI, the outcome could easily be something that doesn't look and act like technology at all. It would be some unimaginable New Thing. Literally no one on Earth has any idea what that would be or whether there would be room for trad-humans in it.