← Back to context

Comment by lsy

9 days ago

There's a very real possibility that AI proponents completely lose the next generation of adults. The output is not enjoyable to consume, the people who rely on it are not cool, and the effects of using it are unpleasant and hard to defend on aesthetic, intellectual, or moral grounds.

There are real use cases for this technology! But the idea that the generation of superficially plausible text is "the next Industrial Revolution" comes out of the same mindset that has turned a neat technology into a banal hellscape for consumers and employees. We desperately need some leadership in companies or institutions that can place this technology in its proper context, and leverage it without getting manic about it.

My great hope for AI is that it kills social media by making 99% of content and comments untrustworthy and not worth consuming.

  • Social media isn’t always about consuming content. It’s also about getting jolts of momentary joy and reward. You get those in two ways: seeing cool things, and participating in cool things. Especially cool things before they go viral. Clicking like on a post that isn’t viral yet, and gambling to yourself whether it will go viral, has the same dopamine flux when it pays off as winning at the slots. Even my reward-defective brain manages to eke out a moment of reward from that. So if you simply remove the content, what’s left is the gambling market. Gambling on something you upvote going viral isn’t about how much content there is in what you placed your bets on, it’s about being able to have that special knowing look when someone tells you about it because you’ve just won the socio-memetic lottery. And AI isn’t doing anything whatsoever to stop that reward loop.

    I proposed once a while back that we should have the HN admins strip all integer counts for a week server-side, to see if the site quality improved or worsened during that time. The mods suggested I ask HN, so I did. HN loathed the idea of it, for every possible reason except this one: removing all those integers would be like quitting gambling cold turkey after years of pulling the vote lever every day. I’m not much less vulnerable to this than everyone else, but I still want to see it happen someday. I remain reasonably confident that our social media site’s quality would skyrocket after a couple days of our posts and comments being disinfected of make-integer-go-up jackpots.

    • I find this idea of getting in early interesting, because it is completely novel to me. Is it common for people to derive so much pleasure from voting for something before it gathers momentum? You really lean into this idea, likening it to winning a jackpot, so I assume it is at least somewhat widespread.

      1 reply →

    • By stopping integer counts do you mean not collecting upvotes and downvotes at all or just not displaying them?

      If it is the later, I think it can be an interesting experiment, although I doubt it matters that much because you can still gauge the "engagement" based on how your posts rank. But there is absolutely no way HN could work if posts and submissions stop being sorted based on their votes. Community moderation via voting is what allows HN to remain functional despite having only two moderators. If votes stopped mattering for a week then HN will likely be flooded with spam by day two and the experiment will be halted by day three.

      4 replies →

    • The vote counting thing can be interesting.

      There's the classic "I wish facebook had a dislike button" or the equivalent for twitter.

      But in the thread-based forum context, removing the downvote has interesting effects. For one, it stops people who down-vote-brigade to lower visibility. It also stops the "I don't like that guy" engagement and works on a more positive "I appreciated this comment" mode.

      It's not one-size fits all but I've seen positive effects on more marginalized forums.

      1 reply →

  • The content being untrustworthy doesn't matter when it comes to social media, as most of what is enticing about social media nowadays isn't the content of the content. It's the fact that there is a never-ending stream of content specifically catered to maximize your dopamine to keep you scrolling.

    So much of social media nowadays is just low quality clips of TV shows/movies with an AI-generated song over them. Or the same Minecraft parkour map as an AI voice recites an r/AmITheAsshole post. Or AI-generated funny videos. The quality of the content doesn't matter at all.

    Anyone I've talked to about how it was all just AI just responds with something akin to "I don't care if it's AI, it's funny! Let people enjoy things!"

  • I have this hope too but social media is junk food now, and junk food is a very lucrative product. People don't seem to care as long as it's engaging.

  • That creates a market for lemons. This is not a good thing. People who create good, valuable things cannot distinguish themselves in such a market, so they exit it. The good creators hurt the most.

    Like it or not, there is a lot of value in public discourse, and we lose all that value if we drown it in noise.

  • Twitter arguably did that a while ago.

    • It’s one of the things I like about it.

      You can only give it a heart, otherwise move on. There’s no Karma or other points.

      Except for view counts etc which are useful for content creators but for the average users it doesn’t do much.

      However you do see the number of likes on your comment and get notification pings so there’s that..

  • Doubt that. Meta got the right idea, ai influencers to your taste.

    So, now people are in groups and chats full of bots posting exactly what they want to hear.

    Instead of meta b it's states, companies, or individuals hoping to make money from their followers

When the leading CEOs are saying the next generation will be unemployed due to AI... uh yeah, you're gonna lose them!

  • Isn't it bad now that Sam Altman and the others are backpedaling on this and going "jobs are going to still exist you just can't imagine them!" because the PR problem was getting so big? [1]

    Like don't we want people running these companies to be honest to the public rather than misdirection?

    [1]. https://www.platformer.news/sam-altman-ai-backlash/

    • > "jobs are going to still exist you just can't imagine them!"

      Ironically, this makes even less sense.

      If (ostensibly) the goal of developing LLMs was so we can all create more while working less, but he also assures us there will be just as much work in the future, then what was the point of this tech in the first place?

      1 reply →

    • From the article:

      > This is a good instinct: one of the virtues of democracy is the way that it gives people a feeling of control over their own lives. People who believe that they can rein in AI companies through votes and laws and regulations will be much less likely to turn to violence.

      I like how this is entirely put in terms of "feelings" and "beliefs" with the ultimate goal being to keep people from resorting to violence. It doesn't seem to play any role how much control people actually have.

    • > don't we want people running these companies to be honest

      What about any of these folks’ biographies hints that they’re capable of being honest?

    • Which one of those things he said do you consider "honest" and not PR? Both of them sound like PR to me, just aimed at different audiences

      2 replies →

IMHO shrugging it off as “superficially plausible text” is the extreme to the other side.

We’re past plausible text since GPT-2 and it’s undeniable that the technology is making waves right now and is having an impact.

As you can’t judge the impact of the Industrial Revolution by the first steam engines, you can’t dismiss the impact the technology is having right now.

  • In writing code, yes. But has there been an actual positive impact in other fields?

    • No. It ruins art, ruins music, ruins communication and on and on. It's cancerous with respect to anything related to art or cultural value.

      22 replies →

    • Medicine?

      There was recently an article shared around here that an LLM diagnosed ER patients more accurately than doctors.

      Looking beyond LLMs image analysis to detect cancer and other diseases.

      Like in coding, AI can and should be a useful tool for the human who decides and is ultimately responsible.

      2 replies →

    • “In producing textiles but has there been actual positive impact in other sectors?” I’m sure the Industrial Revolution didn’t just happen all at once, it started somewhere and crept.

    • support of all kind (including voice), marketing, real-estate, financial... yes, a ton of fields are being very impacted right now but right now doesn't even matter, what matter is what we know it will reach as theory will become practice.

      1 reply →

> comes out of the same mindset that has turned a neat technology into a banal hellscape for consumers and employees

I'm going to say up front that I'm not as familiar with this period of history as I should be, but -- would it be totally unfair to say the same of the "Industrial Revolution"?

I'm not gonna say they're equivalent by any means, but my understanding is the "Industrial Revolution" was hellish for many people. Maybe the mistake is the framing that "the revolution" or "the next big thing" is always a good thing?

  • > the mistake is the framing that "the revolution" or "the next big thing" is always a good thing?

    They are good things. If you were an adult, male aristocrat, yes, your untouched meadows and streams got tainted. If you were a woman you stopped dying in childbirth. If you think of infants as people, they stopped massively dying.

    The Industrial Revolution was good. But it also required erecting the modern administrative state to manage. People had to soberly measure the problems, weigh the benefits and risks, and then invent new institutions and ways of thinking to accommodate the new world.

    • It was good on a long time scale, but I think the parent poster refers to the short term. If I recall correctly, during the early Industrial Revolution the average life span decreased, child mortality went through the roof, and malnutrition meant adults lost their teeth in their early 20s at best. That was… worse. It took time for the revolution to become a net-positive for the average person (which I certainly wouldn’t dispute).

    • > They are good things. If you were an adult, male aristocrat, yes, your untouched meadows and streams got tainted. If you were a woman you stopped dying in childbirth. If you think of infants as people, they stopped massively dying.

      That happened in the Second Industrial Revolution. The First Industrial Revolution was much less comfortable for both workers (who were given much worse working conditions) and the aristocracy (whose landholdings were much less valuable) - it was the middle class who benefited.

      > The Industrial Revolution was good.

      The outcomes of the Industrial Revolutions were good. The experience of living through those revolutions was mixed.

    • How about if you were a working class child, just before they started in a mine or a textile mill? Was it good for them?

      Infant deaths decreased for a while (and NOT because of the industrial revolution):

      > These patterns are better explained by changes in breastfeeding practices and the prevalence or virulence of particular pathogens than by changes in sanitary conditions or poverty[1]

      then rose:

      >Mortality at ages 1-4 years demonstrated a more complex pattern, falling between 1750 and 1830 before rising abruptly in the mid-nineteenth century.

      [1] Davenport, Romola J. (2021). "Mortality, migration and epidemiological change in English cities, 1600–1870." International Journal of Paleopathology, 34, 37–49. PMC7611108.

    • That's primarily the second industrial revolution (~1870-1914). The _first_ (~1750-1840) was... not so great, and note the gap. If your analogy is the industrial revolution, then "well, it's a bit shit now, but it'll all work out fine in 150 years" isn't _great_ messaging, really.

  • The public can't see any trains, electricity, concrete or glass windows, they see employment going away as workers and zero benefit as consumers.

    Maybe AI enables great inventions in a decade, but for now the only appeal is that multinational corporations get to fire workers and everything's filled with slop. Of course they're not happy.

    • I suspect many people during the Industrial Revolution weren't seeing those end products either, only a total upending of their way of life and means of earning a living. And to be fair, many of them probably didn't experience enough of the upside in their lives to make up for the shock of the transition. Ideally this time around we can make that shock less painful, but I'm skeptical.

> There's a very real possibility that AI proponents completely lose the next generation of adults.

The college-age students I interact with hate AI content from other people, but they love using AI for their own work.

They'll pump AI generated memes and AI altered images all day long. Then they'll use ChatGPT to do their homework and write their resume, then look for an AI tool that will spam apply to jobs for them. Then when they get the job they plan to use ChatGPT to level the playing field with more experienced, older peers.

That's not even getting into the AI entrepreneurs who think they're going to use AI to start a company or find a winning strategy to trade memecoins or bet on PolyMarket so they don't have to get a job at all.

I think the next generation is all-in on AI for their own use. They see it as their advantage over the boomers occupying all the good jobs. They think ChatGPT is their cheat code for getting into these companies and taking those jobs.

We are about to experience the commoditization of intellectual work, in much the same way the Industrial Revolution commoditized manual production. I don’t expect a Musk-esque abundance utopia this decade, but the impact will exceed anything we’ve seen in centuries. There is not an industry on earth that won’t change in the next few decades.

To conceptualize AI as merely “superficially plausible text” would be like writing off a Watt steam engine in 1776. The current AI bubble might be early, but it won’t be wrong. The fervor with which corporations are exploring the space stems not from misplaced optimism but an existential threat. Right now every industry is vulnerable to disruption on a massive scale.

And we’re still in the early stages. Frontier models like Claude or GPT-5.5 are still just tuning 2017’s “Attention is All You Need” with MoE, RLHF, and more compute. We are roughly where online services were in the early 90s, when Prodigy and CompuServe were battling it out for market share before the open web swept them aside.

We are still waiting for the modern equivalents of Yahoo, Google, Amazon, and Facebook, never mind the lessers. As Tim Berners-Lee said of the web: “we have not seen it yet. The future is still so much bigger than the past.”

> a very real possibility that AI proponents completely lose the next generation of adults

I doubt it. AI seems fundamentally useful. If the guys at the top can’t get their shit together with messaging and strategy, and it increasingly looks like they can’t, they’ll be replaced before an entire generation is potentially rendered permanently uncompetitive. (And to be clear, there is no rush to adopt.)

> We desperately need some leadership in companies or institutions that can place this technology in its proper context

We need the public debate to stop being set by Altman, Musk et al. We need our generation’s Dickens, Tolstoys, Sinclairs and Whitmans.

What are the ways potential futures with AI, on the spectrum from the familiar sci-fi AGI to more-subtle forms, could work? What are the novel ways it might not? How does capitalism need to evolve? Electoral democracy? Labour organization? If I think to the last few years of television and movies, Westworld is the only one to have contributed anything original to the discourse since Isaac Asimov’s era of science fiction.

  • > We need our generation’s Dickens, Tolstoys, Sinclairs and Whitmans.

    They're out there, but the artists are roundly anti-AI; if you want their input, you have to listen to what they're saying, rather than pretending that dissenting voices are uninformed.

That will happen inevitably, we are throwing spaghetti at the wall right now, and cleaning up the mess, lessons will be learned. The question is whether that phase will lead to real lasting damage and to what. For myself I no longer read cold emails, I believe they are all AI generated, and that communication method may legitimately die culturally. What else will be destroyed?

  • Many things will change, because many things are currently useless in the world right now, literally most jobs in a way shouldn't even exist. You think a guy behind the mcdo counter should exist? It shouldn't, that just an engineering "mistake" as it can already be solved, the world is just slow to catch-up, but it's not only AI, that's just automation. We banked for decades on jobs that virtually shouldn't exist except for the sole purpose of creating jobs, it's like a giant ponzi scheme literally and it will all catch-up at some point.

    I think Society will completely reshape itself over the next decades, likely with UBI and other form of social help and the ones that don't want to partake into the whole "AI orchestration" will just not have any opportunity imo, sad, but this is the way I see it. I truly believe it because myself and ALL the people I know have pseudo-replaced their work with solely orchestrating AI, including very complex jobs and lately because some of my friends asked me, I've also built "agents" that replaced entirely their work, and their employer don't even know about it (customer management, remote) which proves that those jobs shouldn't even exist as they are ALREADY replaceable, all Zoom meetings are immediately recorded, agents do basic loop adversarial with all common models, then proceed with doing tasks and so-on, that last for about 30min and the whole week of work is done, all chats are directly sent to a triage agent as well then the whole rag thing and so on.

    My work went from managing/developing 1 repo to 70 repo at once, evening to morning answering questions like a bot 10h a day with 8 monitors in front of my face, and I'm realistic, I know at some point I can literally replace my own self with an AI as well to answer for me, it's just a matter of time.

    We need to rethink everything and the whole AI hate from the youth will not change anything about it.

    I have multiple friends also running pretty large businesses with 30 or more staff, and right now they are literally at a point where they argue about why they shouldn't fire most of them, it's fuckin sad, but it's the reality.

> The people who rely on it are not cool.

That's the only statement that's true. Admiting to AI use is unfashionable in the western world at this time.

But how much would you like to bet that 90% of those students who were booing also used AI to do their homework for them quite often? So your take away would be "the AI stole their education". No, they were dishonest and the AI helped them cheat themselves out of learning.

Technology doesn't make anything banal or a hellscape, or fire people. Technology is a lever.

If humans use AI to produce worse output because they are too lazy to bother reviewing and iterating on it, that is a human problem. If humans are going to use AI to help them exploit other humans more efficiently, that is also caused by the human rather than the technology.

Also, the ChatGPT moment for humanoid robots is coming this year or next. It will become very obvious that AI use in these robots is not just superficially plausible text.

  • > But how much would you like to bet that 90% of those students who were booing also used AI to do their homework for them quite often? So your take away would be "the AI stole their education". No, they were dishonest and the AI helped them cheat themselves out of learning.

    This is like saying a smoker can't criticize the tobacco industry. It's entirely possible to recognize that AI in school is a huge problem while (hypothetically, in this case) still using it. Indeed, if enough of your peers are using it and you do not, you are effectively being punished for being virtuous. It's a lot like being the one cyclist in the Tour de France who isn't doping.

    Similarly, if your peers aren't able to keep a conversation going in a seminar because they had AI do their reading and assignments for them, then you, as a student, are having your education stolen from you in a very real way. Education is something that happens in community. When enough of your community is using AI, your education will suffer.

    • Again that is a problem with the group of people and how they use technology rather than the technology itself.

      I will die on this hill: AI _properly_ integrated into education will be a huge improvement for students because it will enable each student to have personalized instruction and tutoring.

      4 replies →

    • Smokers can criticize. But they also have to face the cancer that will personally affect them. And hopefully take accountability for it.

> The output is not enjoyable to consume, the people who rely on it are not cool, and the effects of using it are unpleasant and hard to defend on aesthetic, intellectual, or moral grounds.

The AI output you are referring to mostly seems to refer to “AI slop”. It’s not hard to argue that AI slop sucks.

There is a lot that AI does that has created joy for me or people around me:

- whimsical profile pics for online profiles for me, family, and friends

- writing e-mails for community groups — good for a family member who doesn’t have the most sociable writing style

- automating data capture and organization

- automating scheduling with multiple and variable constraints

- catching obvious errors that somehow still happen (e.g., off by one errors)

- filling in gaps in analysis either due to gaps in knowledge or simply an oversight

These are sample of things that I have done or helped people do in the past week, and the results have been well-received.

Maybe I’m part of that solution that you propose, but I have used words similar to “biggest change since…” (I usually say spreadsheets, but I don’t think “Industrial Revolution” is wrong).

Fwiw, I don’t think the result will be dystopian the way most people seem to think that it will. I firmly believe that meat space interactions will gain much more traction, and that will change the way we live and work.

maybe what we really need is a butlerian jihad

  • They were thinking machines at least. Here’s we’ve got a good guesser that fools 50% of the population at anytime that it’s anything but guessing.

Perhaps next generation isn't necessary anymore. At least majority that can't adjust.

Euthanasia for the young might be the best we can offer to the next generation.

Rapidly depopulating Earth below 1 bilion people or less seems in our reach.

I don't really think we should talk about it with "use cases" anymore when it can virtually replace/enhance literally almost any form of white collar work and soon physical labor as well (people will act surprised the moment it comes of course, the same as with LLMs despite all the researchs made prior, if theory supports it = it will be), of course humanoids will be in every homes and they'll cost the same as a phone, soon enough, and we will also not be able to live without.

We don't talk about human intelligence with "use cases", I think we need to be realistic about what AI will be in our lives, most people already can't do without, and this will without doubt expand further.