Comment by odo1242
1 hour ago
But you also burn the exact same number of tokens (actually more) every time the model makes a tool call. It's an agent, it makes a lot of tool calls.
1 hour ago
But you also burn the exact same number of tokens (actually more) every time the model makes a tool call. It's an agent, it makes a lot of tool calls.
This is the right perspective. It costs as much as one additional tool call in the conversation. It’s a bit weird to do it on a timer, which inflates a bit over “just a tool call”, but not by much?