Comment by bearjaws
5 hours ago
Not been my experience, I have it using tool calls in a video game I am building and it correctly adheres ~99% of the time.
I have it retry on failure, but you should do that with any LLM really.
5 hours ago
Not been my experience, I have it using tool calls in a video game I am building and it correctly adheres ~99% of the time.
I have it retry on failure, but you should do that with any LLM really.
I kept having experiences with gpt-oss-120b on Cerebras where it would get stuck in a thinking block and then start endlessly saying things like "Running the command now." or "Making the changes now." and then simply repeating similar sentences like that forever instead of actually making the tool call. It made tool calls other times, so it wasn't an issue with tool calls being impossible, but it just wasn't doing a good job of using them for real instead of simply saying it would. So this was not an issue of it starting a tool call and then putting invalid syntax inside of it, it just would not make the tool call it was supposed to whatsoever. There's no automatic way to retry that.