← Back to context Comment by AstroBen 2 months ago I can see it, it's independently verifiable by others, and it's measurable 7 comments AstroBen Reply nfw2 2 months ago The same is true of AI productivityhttps://resources.github.com/learn/pathways/copilot/essentia...https://www.anthropic.com/research/how-ai-is-transforming-wo...https://www.mckinsey.com/capabilities/tech-and-ai/our-insigh... intended 2 months ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen... davidgerard 2 months ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? 2 replies →
nfw2 2 months ago The same is true of AI productivityhttps://resources.github.com/learn/pathways/copilot/essentia...https://www.anthropic.com/research/how-ai-is-transforming-wo...https://www.mckinsey.com/capabilities/tech-and-ai/our-insigh... intended 2 months ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen... davidgerard 2 months ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? 2 replies →
intended 2 months ago > https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
davidgerard 2 months ago lol those are all self-reports of vibesthen they put the vibes on a graph, which presumably transforms them into data nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? 2 replies →
nfw2 2 months ago "Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:55% faster task completion using predictive textQuality improvements across 8 dimensions (e.g. readability, error-free, maintainability)50% faster time-to-merge"how is time-to-merge a vibe? 2 replies →
The same is true of AI productivity
https://resources.github.com/learn/pathways/copilot/essentia...
https://www.anthropic.com/research/how-ai-is-transforming-wo...
https://www.mckinsey.com/capabilities/tech-and-ai/our-insigh...
> https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
Shows that devs overestimate the impact of LLMs on their productivity. They believe they get faster when they take more time.
Since Anthropic, GitHub are fair game here’s one from Code Rabbit - https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-gen...
lol those are all self-reports of vibes
then they put the vibes on a graph, which presumably transforms them into data
"Both GitHub and outside researchers have observed positive impact in controlled experiments and field studies where Copilot has conferred:
55% faster task completion using predictive text
Quality improvements across 8 dimensions (e.g. readability, error-free, maintainability)
50% faster time-to-merge"
how is time-to-merge a vibe?
2 replies →