Comment by whiplash451
4 hours ago
For inference (Anthropic and OAI are B2C on top of B2B)
To train much larger models. It is quite possible that 10T-100T models be on the horizon
4 hours ago
For inference (Anthropic and OAI are B2C on top of B2B)
To train much larger models. It is quite possible that 10T-100T models be on the horizon
Fable (and maybe Astra) is already a 10T model.
Per a source Astra is a 4.8 trillion parameter (total) model, 5.6 sol was 3.2 trillion.