Comment by bdangubic
1 day ago
Which is it is clear - the enthusiast have spent countless hours learning/configuring/adjusting, figuring out limitations, guarding against issue etc etc etc and now do 50 to 100 PRs per week like Boris
Others … need to roll up the sleeves and catch up
There isn't anything clear until someone manages to publish measurable and reproducible results for these tools while working on real world use cases.
Until then it's just people pulling the lever on a black box.
Hundreds of millions of people use these every day on real world use cases. If they didn’t work, people wouldn’t use them.
This is the measurable evidence you are talking about: https://a16z.com/revenue-benchmarks-ai-apps/
Here's even earlier evidence: https://en.wikipedia.org/wiki/Tulip_mania
1 reply →
All three companies profiled are selling products TO vibe-coders, not apps created BY AI-utilizers.
The shovel seller in the gold rush analogy.
Merely counting PRs is not very impressive to me. My pre LLM average is around 50/week anyway. But I’m not going to claim that somehow makes me the best programmer ever. I’m sure someone with 1 super valuable PR can easily create more value than I do.
Maybe I'm just in a weird place, but I can't imagine 50 PRs a week.
Maybe it's because I spend a lot of my time just turning problem reports reports on slack into tickets with tables of results and stack traces.
automate that shit
1 reply →
A bunch of tiny PRs is not hard to do manually. But LLMs can write boatloads of code to do kind of sophisticated things. You do have to figure out how to get to a point where you can trust the code. But the LLMs can help you write boatloads of tests too based on plain English descriptions.
llms remove a lot of the difficulty of writing a ton of reasonable code, but is that really the bottleneck to producing a bunch of PRs?
isn't it the reviewing time? reviewing code is hard work
2 replies →
Or the tool makers could just make better tools. I'm in that camp, I say make the tool adapt to me. Computers are here to help humans, not the reverse.
so when you get a new computer you just use it, as-is, just like out of the box that’s your computer experience? you don’t install any programs, connect printer, nothing eh? too funny reading “tool should adapt to me” and there are roughly 8.3 billion “me” around - can’t even put together what that means honestly