← Back to context

Comment by trescenzi

1 day ago

This is the core hubris of everyone behind the LLM craze. I do not want to deny their utility there absolutely is some there. But the inherent assumption behind the whole thing is that with a "country of geniuses" problems will melt away. But that's not the case. The reason problems like housing or famines or war aren't being solved is because structurally there's no incentives to solve them not because there's not enough geniuses out there.

And the LLMs exist to further those problems. People can't afford houses? Well, now they won't be able to own computers either. That's a feature, not a side effect. Once the K-shaped economy progresses enough, you won't even be allowed to use the LLMs. They'll exist only to be a tool for the new feudal class who owns you.

Unless you destroy their wealth now.

  • Luckily, the AI bubble will destroy a decent chunk of their wealth.

    The Gartner Hype Cycle [0] is real, and ubiquitous. We are teetering somewhere near the top of the Peak of Inflated Expectations, about to plunge into the Trough of Disillusionment. A lot of very rich people are about to lose a lot of money, and we can only hope that they don't get bailed out (again).

    Then, once the bubble and hype is over, the long, slow work of actually doing useful things with this new tech starts. That's when we'll see it affect everything else.

    [0] https://en.wikipedia.org/wiki/Gartner_hype_cycle

    • The hype will be over one day, but when is that?

      I've done multiple life choices, away from AI, believing it to be a hype, but this hype is still growing, still not dying.

      Both in 2019, as well as in 2023, i.e. not 2 or 3 months ago.

      1 reply →

    • > We are teetering somewhere near the top of the Peak of Inflated Expectations

      I've been hearing this for a year and a half now. That word, "ubiquitous", is getting real mighty challenged. I have tried to insulate myself as best as I could and it just never happens and every other day I wonder if my foil hat needs adjusting. Does yours?

      1 reply →

    • > Luckily, the AI bubble will destroy a decent chunk of their wealth.

      Even if all this is true (personally I doubt it), it assumes the bubble won’t burst before they’ve shifted the money from all our 401ks, IRAs and index funds into their own pockets.

    • Gartner hype cycle isn't scientific and is mostly voodoo marketing gibberish, why do people still post it as if it's real?

    • If the bubble bursts in the worst way it could, we are all fucked, but will recover eventually

      Regardless, people have been making your prediction for a couple years now

  • Once capabilities catch up with the demand (~which is in few years - it just takes time to build!) average person will have much better access to higher quality and cheaper hardware. It's literally how it has always worked, I don't understand why would it be different this time. There's zero substance in your comment, just repeating tired tropes from twitter.

    • Companies have been trying to figure out how to get people to rent pcs for a while. Unfortunately the AI boom has shown them how, buy out all the capacity of the ram manufacturers, pay them enough consistently and the manufacturers have no reason to expand their capacity. No cheap ram means companies and then home users will have no choice but to come to you and rent their pc.

    • A market requires scarcity, because scarcity is what neccesitates trade.

      You can't invoke market mechanisms to defend a post-scarcity scenario.

      Why would the ai owners make things cheaper or even available at all once their abundance machines give them everything they want?

      What would they get out of if it? What could ordinary people trade for it that their abundance machine can't give them already and that would be worth giving up their monopoly on productive force?

      You can't argue "this will change everything" and "this is how it's always worked" simultaneously, and yet AI accelerationists bring out both to defend their ideology.

      4 replies →

  • > That's a feature, not a side effect.

    You’re implying that the deep lizard state planned the LLM craze?

    Sama might be a lizard..

> The reason problems like housing or famines or war aren't being solved is because structurally there's no incentives to solve them not because there's not enough geniuses out there.

Rather: these problems are not solved because there are not enough geniuses who are capable of convincing the masses to send the responsible politicians to hell.

  • A great deal of the supposed smartest people have fully sided with fascism, it's not about smarts

    • This is broadly the same people who bemoaned the idea that the "smartest people in a generation" were all just working on adtech without any reflection about maybe that's not actually an exclusive set of the smartest people... or that a lot of the people in that set were the same one who might, twenty years ago, otherwise be chasing money as middlemen in finance vs doing productivity-expanding things anyway...

      You can be smart and chase the money, but it's crazy hubris to assume that only your peer set of money-chasers are smart.

      It's a small leap from there to "since we're the only smart people, we should get to have the most influence."

    • I’ve heard people say variations of, “Clever people can easily convince themselves of just about anything, if they’re inclined to. And then it’s nearly impossible to talk them out of it.”

      Kinda seems true. And the worst people in history often don’t seem super dumb, despite their various other defects.

    • "Supposed" is doing a lot of work there. Compare, say, Yudkowsky et al. to the people who actually changed the world with mRNA vaccines.

      1 reply →

  • been a while since ive see the real talk on hacker news. its refreshing. usually I feel like I'm the only one among nerds asking to hold people accountable.

    so, how do you think we can do this?

    • > so, how do you think we can do this?

      For a lack of deep knowledge in this area, I don't think I have answers for this, but if one is interested in working on this problem, my approach would be to start with diving deeply into scientific literature about psychology and sociology to find out

      - what convinces people to change their opinions,

      - what causes people to take action

      etc.

      3 replies →

  • > Rather: these problems are not solved because there are not enough geniuses who are capable of convincing the masses to send the responsible politicians to hell.

    People support policies that make housing much less affordable (e.g. rent controls) and oppose policies that would make housing more affordable (e.g. zoning reforms). Saying that it's evil politicians that cause this crisis is dishonest - it's what people want.

    • People by and large don’t understand the second and third order effects of their policy preferences. It’s not that they don’t want those things, it’s that the world is more complicated than their mental model insists it is. Politicians could try harder to fix the fundamental problems but they don’t because the long-term solutions don’t manifest until after the next N (very expensive) election cycles.

    • Rent controls work if you go radical enough and enforce a max profit margin for the whole city, with rent limited to something like 30% over maintenance + debt repayment costs.

      The amount of housing in the city won't grow but it will free up a big part of peoples income that would otherwise go to landlords. That helps the local economy with more consumer spending, and makes it easier to save up or apply for a loan so you can start a business.

      You get a better economy and more money in the average persons wallet without raising taxes. The only ones who lose are commercial landlords, and they will stay profitable by design so it's easy to shut down any complaints. And you get better quality apartments as a side effect because the only way to get more money out of existing properties is to spend more on fixing them.

      1 reply →

    • The politicians are those who created the respecting laws.

      "Convincing the masses to send these politicians to hell" is thus nearly isomorphic to making the masses hate politicians who create such laws, which at least very likely implies that by convincing the masses to send these politicians to hell, a different mindset emerges in the masses.

      2 replies →

    • There is no evidence that reducing rent makes the rent go up - only fearmongering. It's a stopgap measure, though, since there still won't be enough housing to meet demand unless you also fix that at the same time.

      4 replies →

  • For that you might need the kind of geniuses who write stirring books about principles and values. Or whatever the modern equivalent of those books is. Maybe nobody would pay attention to that kind of advocacy in the present day, not sure why. But it's not tech geniuses, anyway. Much though tech has power as a catalyst.

    I suppose there was Project 2025, and there was that book about the inevitability of Russian hegemony (or empire or something) that Putin liked. Those got attention with influential people. Not sure what to conclude from that.

  • > because there are not enough geniuses who are capable of convincing the masses to send the responsible politicians to hell

    I could talk about this for hours, and was last night actually.

    What do vanguardist communism, feudalism, liberal democracy, and fascism have in common? A shared belief that the general population is composed of a bunch of dumb dumbs that need super smart (read: politically educated) people to "lead" them.

    Seems subjective. When is the smartness, big smart enough to allow someone to enter the hallowed ranks of "actually a real human allowed to speak for the masses?"

    There does seem to be a clear delineation between the people you hear about (the vanguard in our example), and the people you don't hear about (the masses): willingness to create confrontation. Most people want to just go with the flow, live in peace. In a dichotomy I've been calling "choose peace or violence," they choose peace. They choose to see bad things in the world or their life and focus on managing their happiness around it.

    I think that this is the default human mode of existence, and that this mode lacks defenses against people willing to violate the default peace. Imagine a bagel line, and someone cutting that line, and when tapped on the shoulder, the cutter breaking into a huge tantrum, and people in line backing down with a "Jesus! It's not worth it, fine." Thus some people learn that they can be much more selfish in life if they're willing to create confrontation and disturb the peace.

    When I talk to people about agitation, civil disobedience, or even just unionizing, the most common thing I hear is anxiety. What if the situation gets worse, what if there's reprisals, what if I lose this little bit of comfort that I've managed to be happy with? That slice could get smaller and smaller but people aren't willing to take the step to say "enough is enough" because I think it fundamentally goes against human nature, we have to sacrifice our own happiness on some level to put our foot down and demand or make change. At minimum we have to acknowledge the discomfort or injustice, which is a diversion from our constructed internal peace.

    Personally I think people should be allowed to live in peace. Maybe the liberal democrats and vanguardist communists are right, maybe most people shouldn't need to trouble themselves with the greater direction of their society. However I think the stability this promises is false; in fact I think all stability is false. I think this constructed peace that people are afraid to disrupt clearly can be torn apart at any moment, not just by people willing to create conflict, but by a literal earthquake, or fire, or plague. Therefore I think there's a couple societies in history that got it right: ones who distributed the responsibility of society across all individuals in the society; namely the brief period of syndicalized Spain, and the several hundred thousand years of certain tribes of native Americans on the eastern portion of the continent. There may be other societies in history, these are just the cases I've been able to read about so far.

    It seems to me that it's possible and necessary for all people to be ready to wake out of their constructed peace long enough to make adjustments together to maintain it. I don't think this is the same thing as them being "led out of it," I think this is each individual being on some level alert to the need to spontaneously say "no, here we wait in line for our bagels. No, screaming about it won't help you, get to the back of the line. Look around: everyone is laughing at how silly you look."

    • > What do vanguardist communism, feudalism, liberal democracy, and fascism have in common? A shared belief that the general population is composed of a bunch of dumb dumbs that need super smart (read: politically educated) people to "lead" them.

      That was not premise of fascism. Certainly not Hitlers one, he himself was self-taught and did not framed himself as highly educated. He considered himself better then educated people. The origin of his superiority was not "smart" it was "strong will and power itself".

      It was not the original premise of feudalism either. That was was about military might, basically.

      And origins of liberal democracy are not "smart based" either.

Yes, many of the problems are 'features not bugs'. There's no reason to think the AIs won't dream up more of these'features' too.

What I like to call at work "this is not a technical problem". There are many problems we could easily solve if we had the right structural incentives. But instead we have politics, processes, layers of management, etc. All that doesn't disappear (yet?) with AI.

  • I believe that’s actually one of the arguments of the boosters. Utopia will finally be reachable when we get all the human drama and bureaucracy out of the way

    I’m not sold, but I’ve heard this line of thinking many times

    • Human drama is what people use to advocate for themselves. Bureaucracy is what people use to protect themselves. Then you have the side effects but, you may also not like a world without those at all.

> The reason problems like housing or famines or war aren't being solved is because structurally there's no incentives to solve them not because there's not enough geniuses out there.

When I asked why Musk doesn't put his money towards non-profits my Musk supporting friends say it's because he "doesn't believe anything but for-profit entities can solve the world's problems".

So why isn't he solving homelessness, famines, war, etc. with capitalism?

To add insult to injury, we're being told: "Just trust us bro, however we make things worse now will totes be redeemed as the prophesied god-mind magically fixes it later."

Strangely, they never discuss the possibility that Multivac might seize all their wealth and cast them down into average-ness. What if it actually comes about, but then it tells us to do the things we already refuse to do?

Agree. I’d only add that I think there is incentive for them to be solved, but there are greater incentives worth more to those leading the charge.