Comment by FrustratedMonky

3 days ago

"A METR randomized controlled trial found that experienced developers using AI coding tools actually took 19% longer on real-world open source tasks. Before starting, they predicted AI would make them 24% faster. The gap between prediction and reality was 43 percentage points."

This is weird, but does seem a common result.

-> AI generates a ton of code fast, but then the human takes a long time to review. Every time the prompt changes. The AI takes a few minutes to generate code that the human will take hour to review.

The reviewing is taking longer than if human just did the code. So why is it so difficult to go back to coding instead of prompting.?