Comment by XenophileJKO

11 hours ago

So I assume it depends on what you train.

- Exact problems on benchmark.

- Similar problems to benchmark.

- Broad class of problems or techniques that might apply to benchmark

Each has very different ramifications for how the model performs. The current evidence is that Anthropic and OpenAI is generally operating lower in the list.