← Back to context Comment by nfw2 3 days ago The same is true of AI productivityhttps://resources.github.com/learn/pathways/copilot/essentia...https://www.anthropic.com/research/how-ai-is-transforming-wo...https://www.mckinsey.com/capabilities/tech-and-ai/our-insigh... 6 comments nfw2 Reply intended 3 days ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen... davidgerard 3 days ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 3 days ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 2 days ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
intended 3 days ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
davidgerard 3 days ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 3 days ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 2 days ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
nfw2 3 days ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? Orygin 2 days ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
Orygin 2 days ago The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive. 1 reply →
> https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.
Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
lol those are all self-reports of vibes
then they put the vibes on a graph, which presumably transforms them into data
"Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:
55% faster task completion using predictive text
Quality improvements across 8 dimensions (e.g. readability, error-free, maintainability)
50% faster time-to-merge"
how is time-to-merge a vibe?
The subject is productivity. Time to merge is as useful metric as Lines of Code to determine productivity. I can merge 100s of changes but if they are low quality or incur bugs, then it's not really more productive.
1 reply →