Comment by janalsncm
18 hours ago
Basically your argument relies on two claims, both of which must be true.
1. Competitors to OpenAI and Anthropic are good because of distillation.
2. OpenAI and Anthropic will come up with some methods for preventing distillation in the future.
Both of these are dubious imo. For RLVR tasks like coding in particular, you definitely don’t need continuous distillation to improve, otherwise OpenAI and Anthropic themselves would not be able to improve because there is no better model to distill from.
No comments yet
Contribute on Hacker News ↗