← Back to context Comment by PcChip 8 hours ago I think flash usually means MoE, not dense 2 comments PcChip Reply jephs 7 hours ago Every frontier model is MoE these days! Flash or otherwise. Sparsity just gets you more bang for your buck. terhechte 8 hours ago Not really. “Flash” generally means fast or cost-efficient, not specifically MoE (Mixture of Experts).- DeepSeek V4 Flash: 284B / 13B active MoE- DeepSeek V4 Pro: 1.6T / 49B active MoE- DeepSeek V4.1 Flash: 552B / 8B input, 16B output MoE
jephs 7 hours ago Every frontier model is MoE these days! Flash or otherwise. Sparsity just gets you more bang for your buck.
terhechte 8 hours ago Not really. “Flash” generally means fast or cost-efficient, not specifically MoE (Mixture of Experts).- DeepSeek V4 Flash: 284B / 13B active MoE- DeepSeek V4 Pro: 1.6T / 49B active MoE- DeepSeek V4.1 Flash: 552B / 8B input, 16B output MoE
Every frontier model is MoE these days! Flash or otherwise. Sparsity just gets you more bang for your buck.
Not really. “Flash” generally means fast or cost-efficient, not specifically MoE (Mixture of Experts).
- DeepSeek V4 Flash: 284B / 13B active MoE
- DeepSeek V4 Pro: 1.6T / 49B active MoE
- DeepSeek V4.1 Flash: 552B / 8B input, 16B output MoE