Comment by staticman2
10 hours ago
Since the Chinese companies publish their research it would have been odd if Mistral didn't start catching up.
10 hours ago
Since the Chinese companies publish their research it would have been odd if Mistral didn't start catching up.
It certainly has helped OpenAI and Anthropic get their KV cache costs under control.
It's no secret that everyone is dis-stealing from everyone else.
I don't see how distillation relates to using the published techniques developed by Deepseek, Moonshot, Zhipu, etc
touche