← Back to context

Comment by simonw

3 days ago

The UK government ran a study with thousands of developers quite recently: https://www.gov.uk/government/publications/ai-coding-assista...

5 comments

simonw

Reply
redhale  3 days ago

I don't necessarily think the conclusions are wrong, but this relies entirely on self-reported survey results to measure productivity gains. That's too easy to poke holes in, and I think studies like this are unlikely to convince real skeptics in the near term.

  • simonw  2 days ago

    At this point it's becoming clear from threads similar to this one that quite a lot of the skeptics are actively working not to be convinced by anything.

    • redhale  2 days ago

      Do you have a study to back that up? /s

      I agree. I think there are too many resources, examples, and live streams out there for someone to credibly claim at this point that these tools have no value and are all hype. I think the nuance is in how and where you apply it, what your expectations and tolerances are, and what your working style is. They are bad at many things, but there is tremendous value to be discovered. The loudest people on both sides of this debate are typically wrong in similar ways imo.

      1 reply →

b_e_n_t_o_n  3 days ago

Woah, finally something with actual metrics instead of vibes!

> Trial participants saved an average of 56 minutes a working day when using AICAs

That feels accurate to me, but again I'm just going on vibes :P