Comment by zkmon
7 hours ago
Why would the agent send the results of the query "Show me my recent transactions" to LLM? This pretty deterministic results which involve no LLM interpretation or decision making.
I understand that people are no longer writing IF expression in their code, because they think it's too brittle, and so they delegate all "IF" branching logic to LLM, but it beats me why displaying of the results from a database query should involve LLM.
Why would this even be in the chat? Showing recent transactions is a basic functionality of a bank.
Taking in the text and calling the database tool is kind of a decision