Comment by paytonjjones

2 days ago

These do make up a huge % of tool calls, but I don't think these make up a huge % of tool call failures.

I see models fail on tool calls that involve API requests to a specific API, internal or cloned Makefile calls, npm run commands, etc.