Comment by nfw2 1 month ago The same is true of AI productivityhttps://resources.github.com/learn/pathways/copilot/essentia...https://www.anthropic.com/research/how-ai-is-transforming-wo...https://www.mckinsey.com/capabilities/tech-and-ai/our-insigh... 6 comments nfw2 Reply intended 1 month ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen... davidgerard 1 month ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 1 month ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 1 month ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
intended 1 month ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
davidgerard 1 month ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 1 month ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 1 month ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
nfw2 1 month ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 1 month ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
Orygin 1 month ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
> https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.
Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
lol those are all self-reports of vibes
then they put the vibes on a graph, which presumably transforms them into data
"Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:
55% faster task completion using predictive text
Quality improvements across 8 dimensions (e.g. readability, error-free, maintainability)
50% faster time-to-merge"
how is time-to-merge a vibe?
The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive.
1 reply →