Comment by stogot

2 days ago

Are the LLM and agent the same thing? Why different nouns ?

The LLM is the core model, but the harness has the prompts/tool definitions, guidance/recovery/correction code. The harness itself is the agent, because same model may perform vastly differently on different harnesses. Agent is the system working as a whole, harness+llm.

LLM is just the thing generating text. It can generate a book, an article, a paper or a conversation. It's the raw "autocomplete" mechanism. You give it input, it generates output.

The agent/harness is the sotware that leverage this "dumb" autocompletion engine to do useful things by sending the good input to the model and doing useful things with the output.

LLM is the digital brain. Agent is a software robot with "sensors" (tooling to read data from files/web) and "actuators" (tooling to perform changes in the environment) that is based on the digital brain.