Comment by coffeefirst

5 days ago

I had the same question because all my experience with this contradicts the hype.

I watched Ronacher's demo from yesterday, https://www.youtube.com/watch?v=sQYXZCUvpIc, and this is it, a well-regarded engineer working on a serious open source project. There's no wizard behind the curtain, it's the thing I've been asking the promoters for.

And you should make your own judgment, but I'm just not impressed.

It seems to me the machine takes longer, creates a plan that "is shit," and then has to be fixed by a person who has a perfect understanding of the problem.

I'm loving LLMs as research tools, pulling details out of bad documentation, fixing my types and dumb SQL syntax errors, and searching my own codebase in natural language.

But if I have to do all the reasoning myself no matter what, setting a robot free to make linguistically probable changes really feels like a net negative.

4 comments

coffeefirst

Reply
Verdex  5 days ago

Thanks for the link.

Given the hype and repercussions of success or failure of what LLMs can hypothetically do, I feel like the only way forward for reasonable understanding of the situation is for people to post live streams of what they're raving about.

Or at the very least source links with version control history.