Comment by zkmon
9 hours ago
Why would the agent send the results of the query "Show me my recent transactions" to LLM? This pretty deterministic results which involve no LLM interpretation or decision making.
I understand that people are no longer writing IF expression in their code, because they think it's too brittle, and so they delegate all "IF" branching logic to LLM, but it beats me why displaying of the results from a database query should involve LLM.
Because they want the user to be able to say things like “show me my transactions for business meals in the last month”. That requires an LLM to analyze the transaction descriptions.
Why would this even be in the chat? Showing recent transactions is a basic functionality of a bank.
Taking in the text and calling the database tool is kind of a decision