← Back to context

Comment by dchftcs

10 hours ago

Unsurprising he'd be cheered for saying what they wanted to hear.

But perhaps whether or not his stance is correct, the students needed to hear this. They (we) have to believe human brains still have value and find a way out; for otherwise there'd be no point to try anymore.

> They (we) have to believe human brains still have value and find a way out; for otherwise there'd be no point to try anymore.

Our value isn't predicated on our utility. The simple fact that we are sentient beings, capable of joy and suffering, gives us value. This is why we continue to support and care for the elderly and the disabled - we value them regardless of any practical utility we may derive from them.

If you go through life believing that your value depends on your practical utility, then things like AI are an incredibly scary existential threat. But denial is not a healthy way to cope with this threat. The solution is to recognize the value inherent in us as humans, and to demand public policies that reflect this fact.

  • > Our value isn't predicated on our utility. The simple fact that we are sentient beings, capable of joy and suffering, gives us value.

    Tell that to my landlord.

  • A view that is not shared always by LLM cheerleaders. Part of Sam Altman's defence of the environmental impact of AI is that it is less than that of a human life.

    "He said it was unreasonable to focus on "how much energy it takes to train an AI model, relative to how much it costs a human to do one inference query."

    "It takes like 20 years of life and all of the food you eat during that time before you get smart," he said. "And not only that, it took the very widespread evolution of the 100 billion people that have ever lived and learned not to get eaten by predators and learned how to figure out science and whatever, to produce you."

    https://www.theregister.com/software/2026/02/23/altman-you-t...

    • It took a 100 billion people and their knowledge,experience to generate the data to train an AI. So that cost also comes under the environmental costs to build his version of AI.

      unless he plans to freeze the training data at this point and use that for another billion years, the cost of building AI will always be more than the cost of humanity.

      3 replies →

  • "A cynic is a man who knows the price of everything, and the value of nothing." - Oscar Wilde

    Or one I prefer, though unattributed: "If the only lens through which you can view life is value in currency, that which is priceless becomes worthless."

  • > The simple fact that we are sentient beings, capable of joy and suffering, gives us value.

    People will understandably ask, what is the actual value of being capable of joy and suffering?

    I frame it another way. There is value in affording all beings dignity, respect, and the opportunity to thrive. The question of our individual value as a being is undignified. People can be more or less valuable to a particular effort, but there should be no question about their worth as a person. It should not be a part of how we understand people and ourselves.

    It is a healthy conclusion that your value doesn't depend on your practical utility, because that will come and go and is sometimes beyond your control. Your value isn't a question at all.

    • > There is value in affording all beings dignity, respect, and the opportunity to thrive.

      > there should be no question about their worth as a person

      Dignity, respect, thriving, and even human worth don't exist without joy and at least a concept of suffering.

    • There's no value in life, but life should be allowed to exist. Who's to say otherwise?

      The lifeless dust and rock of the moon is an simpler value proposition to quantify than the messy intrinsic value of overlapping, ever-changing life here on Earth.

      1 reply →

  • Every year half a million children die of diarrhea. There are so, so many people in the world, who are capable of joy and suffering, who "we" don't care much at all. However I have a feeling that "we" might be joining that group eventually.

    • Still, it’s vastly fewer now relative to the total number of children born than any previous time in human history. It could be even fewer had birth rates begin to drop instantly as a response to child mortality dropping dramatically even in most developing countries, rather than with a few-generation delay.

    • Yea, and I will take it a step further; it is really easy to start to worry about the “worth of a human life” when it’s yours. When we are in the position to not care about the worth of a human for our gain(such as children working to make iPhones for us to use cheaper) we call it economics.

  • > Our value isn't predicated on our utility.

    In the moral sense, sure.

    But our modern day capitalist hellscape has made it extremely clear that if you aren't capable of providing value for shareholders, your life literally has no value. That's the reason the US government keeps cutting welfare programs, why union suppression exists.

    The fact of the matter is that unless you are producing value for shareholders, you don't get to participate in society and are left to starve to death. No amount of flowery language is going to feed and house the unemployed. And we are running full speed into a situation with the explicit and overt goal of cresting as many unemployed people as possible while simultaneously ensuring that there are no resources or help offered to those unemployed people.

    Flowery language will cover up the starving bodies in the streets the same way a can of febreeze will cover up a landfill. This is an enormous problem and if we don't fix it, people will die. Whether or not a human has intrinsic moral value by simply existing, we require money to survive in this society. A human life may be a mystical beautiful and valuable concept, but our society has determined that if you don't have money, you literally do not deserve to live.

    That's what these students are so angry about. They're being pushed into a world that refuses to employ them and which delivers a death sentence for the crime of unemployment.

    • You're conflating society with the white collar job at hand. Yes, if you don't provide value for shareholders, your life is worthless _to that company_. The company is in the business of making money. The businesses goals are a microcosm; a small subset of society. There are many other ways to live (and live well, I might add).

  • I don't think that's quite right, unless you personally value joy for its own sake. I value knowledge, and joy is useful to creating knowledge, and suffering is harmful to it. But I don't want to have some futile joy, and I don't need to avoid some irrelevant suffering.

    Otherwise you get effects like;

    * Just take drugs, feel meaningless "joy" because that's what you value,

    * Don't do anything less "joyful" even though it's more meaningful.

    I'll admit that knowledge isn't practical, and you can't always identify when you're creating it, and a lot of people don't think in these terms and there's a lot of intuition involved, along with societal mores about caring for people which help the growth of knowledge as general rules without getting all bean-counting about it. But I think it matters that hedonism is an incoherent motivation and that creating knowledge is a far clearer one (and hedonism tends to turn into creating knowledge, anyway, if you like meaning). Hedonism, utilitarianism, same difference.

    •   > Otherwise you get effects like;
        > * Just take drugs, feel meaningless "joy" because that's what you value,
        > * Don't do anything less "joyful" even though it's more meaningful.
      

      These are entirely valid positions to take though. Obtaining knowledge for knowledge's sake isn't objectively more meaningful, even if it may be subjectively more valuable to you.

      You could make the point that teaching, and thus furthering the collective knowledge of our species, may be somewhat objectively meaningful, because you impact the trajectory of humanity. But unless you draw joy from that specific fact alone, the joy from creating knowledge is just as selfish as taking drugs to attain a state of bliss (which, again, I don't oppose either.)

      Also, I'd even challenge the notion that knowledge alone, at its face value, automatically equates to a benefit for humanity. Harari has made that point far more eloquently than I in Nexus.

      5 replies →

    • ....I think it's a fairly widespread view to value joy for its own sake. In fact, I would say that's pretty much how normal people would say they view joy.

      2 replies →

  • THIS is going to be the limitation of capitalism. Capitalism isn't compassionate. It's a really good economic framework though, so it will be interesting how that's reconciled in the coming years

    • Money and monetary systems aren't compassionate -- people are.

      Historically (in the USA), capitalism was paired with charity and supporting those around you (primarily for religious reasons).

      One of the greatest downsides of the welfare system is that people don't give the money to others themselves (it's instead stripped from them and doled out without their input). They don't get to experience the good feelings that come from helping another person (only negative feelings about the government taking their money).

      This removes the habits of practicing selflessness and it's positive feedback loop. As a result, we get all the downsides of capitalism with a trained selfish cohort who have no charitable feelings to counterbalance things.

  • The problem with public policy is that it allows other countries to get ahead of you. 'AI' isn't just a tool, it's also a race.

    • What do you win at the end of the race? I've never heard it concisely put. 'Dominance' is the word that comes to my mind, but I don't want to put words in your mouth and don't really know why that would inherently be a valuable trophy, so that's probably not what you were thinking of, right?

      3 replies →

    • Why should we care about that? Even if you wanted to argue our individual fates are tied to our country's, we don't all live in the same country, so how, actually, could we all care? Are you really convinced its so zero sum like this?

      We collectively spend decades and decades creating a sophisticated global capitalism, huge networks and infrastructures of trade and travel, just to find ourselves in some dark forest-esque race with everyone else anyway? Is this really consistent to you? What was the point of anything in the last, like 40 years to you if we just need to act like we are still in a cold war, except this time its a war with everyone?

      6 replies →

  • "Value" is a word with many meanings. Your value as a human or a living being may be very different from your value to your employer or your value to the taxman or anywhere else.

    It is very easy to get lost in between them, especially when listening to a good speaker who can flitter between those meanings at will.

    What is worse is that those values interact. We indeed we continue to support and care for the elderly and the disabled, but only up to a point, and there is a reasonable discussion how exactly should countries divide their limited resources between vulnerable groups, including families with young kids. In that context, the future economic and societal value of a 5 y.o. vs. a 85 y.o. inevitably creeps up.

  • > Our value isn't predicated on our utility.

    Yes it is. If human life was inherently valuable then the concept of poverty wouldn't exist because the entity that sees it as valuable would be willing to spend resources on maintaining it.

    > The solution is to recognize the value inherent in us as humans, and to demand public policies that reflect this fact.

    Most social programs keep expanding until they become unsustainably expensive. You can't just make a law "everyone gets free money" and expect this to have no negative consequences.

    • >If human life was inherently valuable then the concept of poverty wouldn't exist

      This only proves that injustice exists. Surprise: injustice still exists.

      I'm hoping that you're still young and primarily motivated by survival, which can lure you into this cold world view. I think the reality is an inversion of that old "if you're not liberal at 20 you have no heart, but if you're not conservative by 30 you have no brain" chestnut.

      Hopefully once you've made it past the raw basics of survival and the feelings of a dog-eat-dog world, you can look back and realize that compassionate people helped you over and over throughout your life, maybe without you even realizing it at the time. The next step is to realize that you can extend that same compassion to others.

    • If human lives weren't inherently valuable, the concept of charity wouldn't exist. Where does that leave us? I think probably the line of argument doesn't work in either direction.

      Likewise, most of the time you don't have social programs, somebody will introduce social programs. You can't just say "no social programs" and expect this to have no positive consequences... okay this is falling apart a bit, but the point is, what makes 'not expanding UBI' so much harder than 'not introducing UBI'? If you can convince people that introducing UBI will lead to expanding UBI and that that is bad, what's stopping you from just convincing them of the latter?

We’ve also done true intelligence a disservice by using AI to name the current implementation of LLMs. It’s stretching ‘intelligence’ quite a bit. They can be super useful, but we’ve downplayed how phenomenal the human brain is.

I really like ‘Actual Intelligence’, that’s a clever one from Woz. People need to be reminded to use their brains, they’re a brilliant product of evolution (or your favourite god’s work).

Blame Dario, guy has been building something great, while selling snake oil.

Having great tools means more impressive solutions, not fewer blacksmiths.

  • Something changed with Dario a year or so ago. I think he started out with good intentions, although really hard to tell. Maybe it was really all about power and control for him from day one. Certainly now he's a different person - appears totally corrupted by money and power.

    Dario used to at least emphasize the potential positives of AI while being worried about the negatives, but unlike Hassabis/DeepMind he has done nothing to bring about the positive part and is now just accelerating the harmful part as fast as he can. Google is an AI company, bringing us things like AlphaFold, and Anthropic (also OpenAI) are just LLM companies.

    • It's just the worst version of capitalist game theory. If I don't do the bad thing and get rich, then someone else will do the bad thing and I won't get rich.

  • I spent more than half my day yesterday telling Claude to correct itself because it did things I explicitly told it not to do in my prompt.

    “You’re right - I overstepped”

    Is the new “You’re absolutely right”.

    I don’t know if we can qualify something that actively goes against the explicit instructions you give it as “something great”. It just sounds like Dario is building snake oil and selling it too.

    • I have a script at work that writes out some config files and I'm having Claude run them after making changes. The script if it detects breaking changes will spit out a message saying what the breaking changes are, and not do anything, telling you to rerun it after validation with the override flag.

      If I don't tell Claude about this behavior, it ignores the script output and lies about passing tests that validate if the config files were regenerated.

      So I added to my prompt instructions to observe it, and if it sees that message, double check its work and then inform me and ask what to do before proceeding.

      This has had the net result of Claude either running the script with the override flag from the get go (explicitly forbidden) or it seeing the message and convincing itself that the override is warranted and running it a second time with the override flag. It's never once stopped to ask me what to do like instructed.

    • This is one of a few reason I strongly prefer GPT and its codex variants. It seldom frustrates me, sure its not omnipotent in any way, but it just feels very "tuned in" when it comes to understanding intent and scope.

    • Imagine worker that did loop of "you're absolutely right -> same fuckup again" multiple days every week, wasting time of whoever told them to do the task

      They'd be out of company after a week

      5 replies →

  • But this new tool is not a blacksmith’s tool in the traditional sense. It’s more like an automated blacksmith that works fast, for cheap, does mediocre work, but has this mediocre skill level in an exceptional broad range of tasks.

  • Blacksmiths is not the best analogy here.

    • Why not? Blacksmithing and coding have a hell of a lot in common. In both disciplines toolmaking is extremely important. Often you have to make custom tools to accomplish a design--e.g. a twisting wrench or a form tool. Sometimes you have to make tools that get used once and thrown away, like a jig temporarily welded to a piece to hold it in place while you build its sibling assembly. Sound familiar? I do this kind of thing all the time in code.

      Another similarity is the relative simplicity of the underlying structure of the system. You essentially have two hammers (one small one you swing with your hand and another big one that is planted on the ground), some material, and some heat. You build the rest.

      Another similarity is the resistance to automation. A skilled blacksmith is a versatile worker. You can create assembly lines to automate any one thing they might produce. The end product will not have the same quality--it will not truly be wrought iron, each piece will not be unique, there will be nothing of the aesthetic taste of the artist in it, but if you're just some bean counter who doesn't care about those things you'll be able to sell it. But if you need the optionality to produce any of those things.. automation is not your friend. And some things just cannot be automated, at least not without extreme costs or very poor results--shoeing horses comes to mind.

No AI company is addressing the elephant in the room that you need someone experienced constantly monitoring any agentic workflows. This means that the cost savings of agents are a myth.

My company actually did an internal study of agent usage for coding and found it only improved productivity by 10-20%, basically on the same level as good code templates or an autocomplete.

  • I maintain a part of my team's CD process and I've observed a 30% increase in PR velocity since we started adopting agentic tools but it was a "one-off" increase (as-in, it hasn't continued to increase beyond that since about a half-year ago).

    I'm guessing though that there are other improvements in code quality and feature velocity. I've noticed personally that AI is really good at catching smaller things that are easy to miss (e.g., if you ask it to rename fooTheBars it also updates all the relevant comments or enums that you might have missed).

  • > My company actually did an internal study of agent usage for coding and found it only improved productivity by 10-20%, basically on the same level as good code templates or an autocomplete.

    That's still a pretty good outcome. 20% more output across a company is huge when you think about it. Definitely not going to change the world completely though.

    > No AI company is addressing the elephant in the room that you need someone experienced constantly monitoring any agentic workflows. This means that the cost savings of agents are a myth.

    I mean, it depends on the agentic workflow. Like for production code, definitely. For document and claim review, you probably need a targeted sample on a daily basis but you get massive gains.

  • Less and less true with every new generation of AI systems.

    AI gets better and better at operating self-supervised, and the amount of skill needed to supervise an AI in a useful fashion only ever goes up.

I don't believe there will ever be any artificial intelligence, not with Markov chains (next token prediction), not otherwise. Especially not now when the current ML hype is already winding down. And yes this is a matter of belief since I don't think any science precludes agi from existing nor is there any reason to be sure it could someday materialize. I honestly would rather believe societal collapse hits us before agi can even be theorized.

  • I don't believe there will be self driving cars that will be perfect and never get into any accident or cause someone to die.

    That does not matter when discussing its practicality; or whether they will cause drivers to lose jobs.

  • >I don't believe there will ever be any artificial intelligence, ...

    Sounds like you're talking about AGI, not AI. AI is here today.

    • AI was here in the 1970's too for that matter, in the form of expert systems. "AI" is the label that perennially gets applied to whatever current technology does something that was previously considered similar to human intelligence, then later on gets removed and applied to something new.

      You'll know were making progress towards AGI when LLMs start being called LLMs again, and something new starts being called AI.

      1 reply →

Woz is a different kind of geek, appreciates the craft, and can sort out the cruft out of it.

AI will be there, but it'll transform. When I say I don't use AI (i.e. LLMs, chat interfaces, agents and "autocomplete") for coding, research and whatnot, people label me as a luddite. The fact is I know how to use them. I test them from time to time. Occasionally these tools help. More often they hinder.

"Resistance is futile, hand your brain over!" is a hype filled dystopian fatalism noting that future is inevitable. It's inevitable. You can use this correctly, and we don't got back to our senses to understand how to use this correctly and efficiently.

We are just cooking our planet right now, with heat, poisoned water and slop.

  • Auto-complete on steroids, is still my favorite analogy for AI. I don't mean that in a negative way either. Autocomplete is very good, but that never stopped me from learning English grammar and spelling.

    • Quite right. I'm worried about the impact that LLMs will have on the learning process, especially in programming, but also in writing. Programming and writing are both skills that seem simple, but take an absolutely staggering amount of practice to master.

      Think about how much your own writing (and programming, if you were lucky enough to start early) evolved from, say, age 12 (when a lot of smart kids start to tackle 'real' books) to age 18 (when you supposedly have a good enough education for 50% of work in most countries) to age 25.

      All of that evolution is a direct result of one thing: practice! But with a magic answer box available in everyone's pocket, it'll take truly Herculean effort from a learner to actually grind through the practice instead of just cheating for an answer. I really worry how much an LLM user will actually comprehend their own code or even prose; if you've scarcely written a line of code, how can you really understand what's going on in a debugger? If you haven't done the legwork of writing essays and constructing coherent arguments and comprehending grammar, how will you ever communicate effectively?

      Maybe I'm just a dinosaur and these kids will sail a whole level of abstraction above my own understanding of writing and programming, much like how my own generation preferred Python to C, and how the previous generation evolved from assembly to C/BASIC/etc. But then I come back to those missing fundamentals, that empty mental model. It's not like my English or CS teachers had me grind through essays and implementing linked lists and Djikstra's Algorithm for pure busywork. They did it because practice is the only way to truly immerse a student in a practical subject. Maybe it'll work for programming, as long as LLMs get good enough that you can always ask them to fix low-level errors for you? But it seems unlikely to work in prose. And even those generational programming jumps I mentioned (assembly to C to Python) were lossy; most kids I went to school with would be absolutely useless writing C code, and even as a bit of a dinosaur I'm pretty awful at even debugging assembly.

      Like you said: you still need to learn grammar and spelling. And I suspect a whole skill tree of other fundamentals!

      2 replies →

    • The way I think of it has evolved a lot over the last 5 years. At this point I think human brains probably do something analogous to next token prediction when we think. For all the hype, I think LLMs are actually more, not less, intelligent than that average person realizes. I think it’s legit, actual intelligence, not just “artificial” intelligence. That may be a hot take but it’s just my perception.

      15 replies →

>the students needed to hear this.

I thought that was the objective of these celebrity speeches.

Yes! We need them to have hope, but hopefully there can be substance behind it, otherwise it's like when the Hitler Youth got those badges before Hitler killed himself. In the sense that we are awarding people medals when their future is bleak