Comment by redox99
4 days ago
It performs worse than Muse Spark 1.3 and 1.2. And it has an outdated attention mechanism which at 1M tokens will need over 200GB just for the KV cache.
Very disappointing release. We're lucky to have Chinese models.
4 days ago
It performs worse than Muse Spark 1.3 and 1.2. And it has an outdated attention mechanism which at 1M tokens will need over 200GB just for the KV cache.
Very disappointing release. We're lucky to have Chinese models.
No comments yet
Contribute on Hacker News ↗