Comment by jason_oster

2 days ago

Honestly? LLMs are currently above average at programming.

We've all been through The Daily WTF at least once. That's representative of the average. (Although some examples are more egregious than others.)

> The Daily WTF at least once. That's representative of the average

I'd say The Daily WTF are the more spectacularly weird and wrong, not representative; I've seen a few things deserving to be on their site in real life*, but the average I've seen has been much better than that.

It's difficult to be sure, but I think these models are roughly like someone with 1-3 years of experience, though the worst codebase(s) I've seen have been from person(s) who somehow lasted a decade or two in the industry.

* 1000 lines inside an always-true if-block, a pantheon of god classes that poorly re-invent the concept of named properties, copy-pasting class files rather than subclassing even after I'd added comments about needing to de-duplicate things in them, and that was all the same project.