Comment by imtringued
3 hours ago
At those token rates you could treat the LLM as a compiler and rebuild your software from scratch every week. That would mean the end for AI slop because people who spend the effort to build a process that creates high quality software from scratch can take full advantage of the one shot performance of an LLM without having to release the process itself.
Youre completely missing my argument. Speed is not the bottleneck, its the review burden.
You need human review when working on anything not table stakes. You cannot write shitty code for an avionics package on an airplane under the assumption that if we encounter bugs, its no big deal because we can rewrite it super fast..
It seems like all these bullish takes on AI are coming from people who think all software runs in a browser, and simply exists to take stripe payments or serve ads. Most software is actually very high stakes and lives depend on it and have high compliance burdens.
Just because it can "one shot" (which actually means 90 tools calls and a whole lot of brute forcing against tests/linter/compiler, and possibly reward hacking) to something that runs, does not mean it will continue to run well.
People treat llm made software like disposable code. You're the only one using it, typically on a single machine with no real world multi-user testing, but for some reason we derive from the fact it worked well the 3 times we used it, on a single machine with a single user that it is evidence of llm solving programming. Its bogus.