Comment by renewiltord

A more general application of this is why we have LLM tool use. I don’t have the LLM figure out how to integrate with my blog, I write an MCP and expose it to the LLM as a tool. Likewise, when I want to interpret free text I don’t push all the state into the LLM and ask it to do so. I just interpret it into bits and use those.

It’s just a tool that does well with language. You have to be smart about using it for that. And most people are. That’s why tools, MCPs, etc. are so big nowadays.