← Back to context Comment by nfw2 2 months ago The same is true of AI productivityhttps://resources.github.com/learn/pathways/copilot/essentia...https://www.anthropic.com/research/how-ai-is-transforming-wo...https://www.mckinsey.com/capabilities/tech-and-ai/our-insigh... 6 comments nfw2 Reply intended 2 months ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen... davidgerard 2 months ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 2 months ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
intended 2 months ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
davidgerard 2 months ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 2 months ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 2 months ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
Orygin 2 months ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
> https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.
Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
lol those are all self-reports of vibes
then they put the vibes on a graph, which presumably transforms them into data
"Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:
55% faster task completion using predictive text
Quality improvements across 8 dimensions (e.g. readability, error-free, maintainability)
50% faster time-to-merge"
how is time-to-merge a vibe?
The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive.
1 reply →