← Back to context

Comment by cowanon77

5 hours ago

I think it's a good thing. In a couple of years we'll have a clear way to measure the true productivity and impact (or lack thereof) of AI on software dev. It's the perfect "natural experiment".

7 comments

cowanon77

Reply
WesBrownSQL  1 hour ago

We have ways to measure productivity now. AI doesn't change what to measure unless you just want to flex. Every time I see "100k lines of code, all AI," I think they probably could have done the same thing with a fraction of that. Anytime productivity is measured that way, you will always fail. As a CTO, my mantra was "I pay for outcomes, not hours." AI coding tools are just that, tools. My outlook on that hasn't changed. I enjoy working with LLM's especially locally, to handle quite a bit of the heavy lifting. I'm not paying for tokens, I'm paying for outcomes.

serf  1 hour ago

projected ideology doesn't really match reality, so not really.

detecting AI written code without a minder chained to your arm watching your every movement is still a topic of research...

...and as someone who has been to the last 10 miscellaneous FSF/GNU celebrations I can tell you that community has just as many license cheaters and scoundrels as the rest of the computing world, they just tend to bias towards the good stuff, similarly to how every microsoft employee isn't required to drink the blood of infants (it just looks good on quarterlies.)

asf_opp  5 hours ago

No. If an open source project allows small amounts of LLM slop to please their foundation donors, is all productivity in that project due to LLMs? Of course not.

If 10 of 20 developers work for corporations and have to pretend that their code is AI written to please the corporations, is that AI productivity?

The advertising and social pressure machinery is so AI heavy right now because most techies are cowards and only speak up on issues (including DEI as we see since Trump) if HR tells them to.

Then of course many projects like Linux or git are entrenched. You can't copy Unix and bitkeeper like Linus did and be immediately successful, because the whole culture is against you (unlike in the 1990s, when the culture was anti-Microsoft).

So yeah, if Gen-Alpha declares OpenAI and Anthropic the new Microsoft and builds up a new counter-culture, then in 10 years you might have some clue.

Otherwise, we have to stick to the current situation and observe that no software has gotten better since AI.

  • bobthebuilders  2 hours ago

    So if software is developed with AI and that's better then we should discount AI's contribution, but if software is developed without AI is better then obviously it's because AI had no productivity boost?