Comment by killerstorm
6 months ago
LLM can give you thousands of lines of perfectly working code for less than 1 dollar. How is that trivial or expensive?
6 months ago
LLM can give you thousands of lines of perfectly working code for less than 1 dollar. How is that trivial or expensive?
Looking up a project on github, downloading it and using it can give you 10000 lines of perfectly working code for free.
Also, when I use Cursor I have to watch it like a hawk or it deletes random bits of code that are needed or adds in extra code to repair imaginary issues. A good example was that I used it to write a function that inverted the axis on some data that I wanted to present differently, and then added that call into one of the functions generating the data I needed.
Of course, somewhere in the pipeline it added the call into every data generating function. Cue a very confused 20 minutes a week later when I was re-running some experiments.
Are you seriously comparing downloading static code from github with bespoke code generated for your specific problem? LLMs don't keep you from coding, they assist it. Sometimes the output works, sometimes it doesn't (on first or multiple tries). Dismissing the entire approach because it's not perfect yet is shortsighted.
They didn’t dismiss it, they just said it is not really that useful which is correct?
2 replies →
well I presented the statement wrongly. What I mean is the use case for LLM are trivial things, it shouldn't be expensive to operate
and the 1 dollar cost for your case is heavily subsidized, that price won't hold up long assuming the computing power stays the same.
Cheaper models might be around $0.01 per request, and it's not subsidized: we see a lot of different providers offering open source models, which offer quality similar to proprietary ones. On-device generation is also an option now.
For $1 I'm talking about Claude Opus 4. I doubt it's subsidized - it's already much more expensive than the open models.
Thousands of lines of perfectly working code? Did you verify that yourself? Last time I tried it produced slop, and I've been extremely detailed in my prompt.
Yes. I verified it myself. Best results from Opus 4 so far, Gemini might be OK too.
Try again.
Any retries before nailing the prompt are still going to be billed, so this supports GP position about LLMs being expensive for trivial things.