Comment by rammler

Kimi is a great model but it was clear from the start they achieved they brute forced that performance through scaling. The frontier models K3 compares to are rumoured to be smaller also. GLM on the other hand is way ahead in perf/parm but severly compute bound. Now once GLM can scale up or Kimi optimizes the training more, that gonna be fun times.