Comment by meander_water
1 day ago
Interesting, if you take a look at the median throughput chart [0], groq goes insane after 7th Oct. Wonder what happened.
[0] https://openrouter.ai/moonshotai/kimi-k2-0905/performance
1 day ago
Interesting, if you take a look at the median throughput chart [0], groq goes insane after 7th Oct. Wonder what happened.
[0] https://openrouter.ai/moonshotai/kimi-k2-0905/performance
2x jump overnight. new LPU hardware? I checked the speed for groq's gpt-oss-120B, Llama4-maverick, and Llama4-scout; none of them had a noticeable change this month
Heavy quantization
They claim (or someone on Reddit who claims to be staff claims) that's not accurate: https://www.reddit.com/r/LocalLLaMA/comments/1mk4kt0/comment...