Comment by vatsachak
2 hours ago
That's a fair use case for them though. LLMs are superhuman at short term performance engineering/debugging/testing. But even that comes with the caveat that these commits come from talented coders using LLMs as a grad student. I think that OP is against the claim that "agent in a loop beats a talented human at long term coding tasks".
Because if it was true then open source projects such as GIMP could basically be as feature heavy as Photoshop overnight.
I, too, will reject the idea that "agent in a loop beats a talented human at long term coding tasks".
LLMs amplify existing expertise. Give them to experts and you can get fantastic results. Give them to amateurs and you might get the occasional impressive demo, but you're not going to get anything that a responsible software team would commit to maintaining in the long term.