Comment by deno
7 hours ago
This likely comes down to how it accessed the bus schedules (i.e. web search tool) and not intelligence.
You need to add the actual bus schedule to context somehow (research agent, custom tool or just dump in prompt) and even the simpler modern models will be able to do the planning.
Tool usage competency is part of overall intelligence. If the model can't get the information it needs, it must clarify that in the response.
This isn't tool usage competency, it's tool quality and/or luck. Regular web search is not good for grounding if you want accurate results. You can ask the model to make a tool for getting bus schedules and then use it only then you are comparing apples to apples in this case.
If the model can't get the information it needs to accurately answer the question, it must surface that risk to you instead of guessing. This is part of model intelligence and tool use competency. Fable and to a lesser extent Opus is very good at this