← Back to context Comment by dumberquestions 10 hours ago Which model? Or how many active parameters? 6 comments dumberquestions Reply _whiteCaps_ 10 hours ago Llama 3.1 8B model dumberquestions 9 hours ago So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq). mdp2021 9 hours ago https://taalas.com/h-content/uploads/2026/02/graph.png 1 reply → anthonypasq 9 hours ago im assuming energy expenditure is substantially lower as well
_whiteCaps_ 10 hours ago Llama 3.1 8B model dumberquestions 9 hours ago So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq). mdp2021 9 hours ago https://taalas.com/h-content/uploads/2026/02/graph.png 1 reply → anthonypasq 9 hours ago im assuming energy expenditure is substantially lower as well
dumberquestions 9 hours ago So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq). mdp2021 9 hours ago https://taalas.com/h-content/uploads/2026/02/graph.png 1 reply → anthonypasq 9 hours ago im assuming energy expenditure is substantially lower as well
Llama 3.1 8B model
So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq).
https://taalas.com/h-content/uploads/2026/02/graph.png
1 reply →
im assuming energy expenditure is substantially lower as well