← Back to context

Comment by lvl155

7 days ago

It is not SOTA. Give me a break. Sure, run it on Cerebras to get speed but that’s pretty much its advantage.

Agreed. The benchmark closest to my experience is FrontierMath Tier 4. Fable and Sol (90%) are very far ahead of Kimi K3 (not even 40%). Kimi is trained heavily to basic agentic tasks, like all the other open models right now.

Cerebras does not share the quantization of the models so you don't know if you're getting real K3 or k3 lite or something else.

  • It most likely will be quantized. A cerebras wafer only has 44gb ram, and linking them together vastly reduces the speedup.