Comment by danielbln
5 days ago
It's a while loop. You collect a ton of context (file paths, function signatures, etc.), provide a bunch of functions to the LLM that it can ask to be called and an objective ("Implement X", "figure out X"). Then you send this to the LLM, perform the function calls it requests ("open file", "edit file", "call service X") and append their output to the payload and send it back to the LLM. Rinse and repeat until objective is complete (in which case the LLM may request to call a work_complete function/tool).
That's really it. Stuff the context, loop over the LLM until work is done.
Thank you!