Comment by stingraycharles

6 days ago

Exactly. I want the LLM to be able to respond to our customers’ questions accurately and/or generate proper syntax for our query language.

The whole point of base models is to be general purpose, and fine tuned models to be tuned for specific tasks using a base model.

Just to be clear, unless I'm misinterpreting this chain of comments, you do not want to fine-tune for information retrieval. FT is for skill enhancement. For information retrieval you want at least one of the over 100 implementations of RAG out there now.

  • Tool calling is a form of RAG, among the others. This is where MCP is really starting to move this forward.