Comment by verdverm
5 days ago
I'll wait for more studies about productivity, one data point is not solid foundation, there are a lot of people who want this to be true, and the models and agent systems are still getting better
I'm an experience (20y) developer and these tools have saved me many hours on a regular basis, easily covering the monthly costs many times over
There’s not enough data…which somehow proves your pre-existing bias which goes against the only data we have.
I'm offering my anecdotal evidence as contrary to the loss of productivity piece that has been making the rounds, not as justification that they are wrong, but that we don't have enough data
It's also not the only data, here's one with results in the other direction
https://medium.com/@sahin.samia/can-ai-really-boost-develope...
> Productivity was tracked through metrics such as completed tasks (pull requests), code commits, and successful builds.
Making untested garbage faster to check off tasks quicker. Reopen rate please? New bug task rate? Nobody looked...
> The study also monitored code quality via build success rates. Importantly, increased productivity did not come at the cost of more errors, showing that Copilot helped developers code faster and more accurately.
It builds therefore it works. And the test suite was also AI generated?
Feels like we're back in primary school learning programming.
Classic case of gaming the metrics.
2 replies →
Glad to see more data!
It’s interesting they showed the biggest gains for junior developers. The other study showing productivity losses for experienced developers. That suggests these tools are a lot more helpful for junior developers compared to senior developers at the moment.
1 reply →