Comment by yorwba

For agentic tasks where the model outputs tool calls that run on the customer's computer, you can't just store and eval later, because then the execution environment is no longer available.