Comment by lostmsu

1 hour ago

Technical report has a graph vs Kimi K2 with 1e21 FLOPs (but they don't claim that's the entirety of pretraining)

0 comments