Comment by ako
7 hours ago
Opus and Gpt are generic LLMs with knowledge on all sort of topics. For specific use cases you probably don't need all the parameters? Suppose you want to generate code with opencode, what part of the generic LLM is needed and what parts can be removed?
we're already doing that, it's called distillation and how models like deepseek are trained.