Comment by slrainka

That's the thing. LLM's can be used as a real-time teaching layer and build systems that can operate at deterministic speeds and escape hatch into a LLM when confidence levels drop. This approach has helped us save more than $1 Million annually against the straight LLM classifiers at scale (and pass that on to the customers)

https://sureshsubasinghe.substack.com/p/how-to-cut-agent-llm...

https://sureshsubasinghe.substack.com/p/the-god-model-fallac...