Comment by bigstrat2003

They cannot be trusted to produce output that works (let alone works well) because they are just statistical models, without any actual understanding of what they produce. That means that you have to carefully review every single line of code they produce, because you don't know where the hallucinations will be. But by the time you do that, you have saved no time at all (indeed, in my experience you lose time), because typing the code was never the part that took time. It was understanding the problem. So if you use an LLM, you spend a bunch of money for zero gain in productivity, or you sacrifice quality and pray there aren't nasty bugs lurking. I certainly think it's fair to call that state of affairs "it doesn't work".