Comment by pylotlight
10 months ago
Typically I'd use tools for that as context will be finite, but I hear it does a decent job at tool calling too so should see solid perf there.
10 months ago
Typically I'd use tools for that as context will be finite, but I hear it does a decent job at tool calling too so should see solid perf there.
8b was very bad at tool calling. 30b does an "ok" job but requires the wrapper to do a lot of job, like for example the model will be very random, either have multiple tool_call ags, or have multiple tool calls in one tag inconsistant. but "handle-able"