Comment by oudlys

6 hours ago

Productivity is not value. It's quite possible for you to experience productivity improvements, and actual value to not be created. That is what I think the most robust data is showing.

https://unessays.substack.com/p/talk-is-cheap

From an economic perspective productivity is defined as the creation of value isn't it? Then if you "improve productivity" and does not create value in the end you're no improving productivity at all.

  • It does depend on how you define productivity. But the way it's commonly used is "I'm going faster, personally, with these tools."

    The thing people I think have a hard time seeing is that "I go faster" does not mean "more features get finished".

    It's a scale issue, and one scale is better than the other. People only pay for finished features, they do not pay for how much code you emit.

    • economists define productivity as gdp per hour worked. Like a lot of other economic measurements, its mostly a bogus number people use as an argument on why their politics are better than someone elses politics. You can have an efficient business located in a poor country making the same product and same quality as that same business in a rich country, the rich country will be more "productive" because local cost of goods is higher there (i.e. a restaurant in NYC is more "productive" than a restaurant in bangladesh).

      2 replies →

  • Productivity is defined revenue per worker hour. And we know worker hours are going down as there are fewer workers with the layoffs.

Also, supposed productivity gains are dubious. I personally experience at best no productivity gains when using LLMs to write code, and sometimes it's an active drain on my productivity. There was that one study a year or so ago showing similar results. People are trying to say the productivity gains are there and undeniable, but that is not true. It is very much a subject of controversy whether AI helps productivity.

  • I can see an argument that the productivity gains are illusory / don’t translate to economic productivity. I’m not denying the possibility.

    However, most of the engineers I respect have gone from being skeptics a year ago to convinced today. I don’t personally know any true holdouts any more. If there are studies that disprove productivity gains more than six months ago, I’m happy to believe that it was true of the AIs that were available at the time. But I’m going to need something much more recent before I disbelieve my lyin’ eyes where it pertains to the AIs available today.

    • I’m going back to being a holdout, but it’s nuanced - My theory into why LLMs don’t lead to the colloquial definition of productivity would be something like - if code was never the bottleneck than generating code faster doesn’t result in more meaningful output.

      Even if you take for granted that AI is as good as the best people say in writing code. And Ive spent a lot of time generating codes, I won’t disagree - Then the question becomes - does this change your daily incentives such that you reach for code as the solution to your problems rather than something else (coordinating with your colleagues? Product management? Planning and Design?

      So from a holistic perspective, I think intentionally limiting your own AI usage is the best approach for maximum long-term productivity.

    • Its funny, I've noticed the same thing, but did not come to the same conclusion.

      I currently don't have work access to Claude Code, but most of my teammates do. Watching from the outside, the cycle seems to look like this:

      1. Experience some success, which hooks you into relying on AI.

      2. The AI keeps failing at some task, but you don't want to stop. Keep trying over and over again.

      3. Run out of tokens and take a break.

      Now, sometimes 1 doesn't happen. Sometimes 2 doesn't happen. 3 is a certainty though.

      Now, if you told me that the productivity gain from 1 is enough to offset the loss from 2 and 3, I could believe you. But I also wouldn't be surprised if it didn't.

      1 reply →

That's possible, sure. But I think the answer is more likely in the numbers, not in just qualitatively saying AI isn't worth anything. Like if I pay $30k for an ounce of gold, I got value. Gold is worth something. But that amount of gold wasn't worth what I spent.

EDIT: In fact, parent comment has a link to some numbers.

[EDIT: Most] people don't want to go through the numbers. Ok. But there's a history here. When people don't want to see the numbers, certain kinds of things tend to happen.

  • I've posted numbers that indicate that productivity is becoming decoupled from value delivery. If you follow the link in my comment it reviews a pretty robust study of 4000 teams over 2 years. There is no product throughput increase.

    • Yep.

      Code acceleration is great, but.... something precedes that. Vision and strategy re. expansion of offerings and businesses. Once a firm reaches maturity in what it offers and is only touching the edges - this code acceleration is literally useless when you factor in all of the trade-offs.

      This is a good thing - it means fat and slow incumbents are sitting ducks to be out-witted by creative and imaginative founders, which is healthy for a well-functioning economy.

      Now the economics of existing frontier models are not sustainable - its looking like a mix of the airline (supersonic vs subsonic) and EV industry with China in the background providing decent offerings at much lower prices.

      5 replies →