← Back to context

Comment by girvo

5 days ago

> which the LLM presumably also fixed after finding them

In my experience: not always, and my juniors aren't experienced enough to catch it, and the LLM at this point doesn't "learn" from our usage properly (and we've not managed to engineer a prompt good enough to solve it yet), so its a recurring problem.

> if prompted correctly

At some point this becomes "draw the rest of the owl" for me, this is a non-trivial task at scale and with the quality bar required, at least with the latest tools. Perhaps it will change.

We're still using them, they still have value.