Comment by mycall
1 month ago
I found that fine-tuning and RAG can be replaced with tool calling for some specialized domains, e.g. real-time data. Even things like user's location can be tool called, so context can be obtained reliably. I also note that GPT-4o and better are smart enough to chain together different functions you give it, but not reliably. System prompting helps some, but the non-determinism of AI today is both awesome and a cure.
Tool calling is just systems integration with a different name. The job of the tool is still to provide context from some other system.
> I found that fine-tuning and RAG can be replaced with tool calling for some specialized domains
RAG is just a single-purpose instance of the more general process of tool calling, so, that's not surprising.