Comment by _whiteCaps_ 10 hours ago Llama 3.1 8B model 4 comments _whiteCaps_ Reply dumberquestions 9 hours ago So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq). mdp2021 9 hours ago https://taalas.com/h-content/uploads/2026/02/graph.png Gander5739 8 hours ago https://xkcd.com/1162/ anthonypasq 9 hours ago im assuming energy expenditure is substantially lower as well
dumberquestions 9 hours ago So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq). mdp2021 9 hours ago https://taalas.com/h-content/uploads/2026/02/graph.png Gander5739 8 hours ago https://xkcd.com/1162/ anthonypasq 9 hours ago im assuming energy expenditure is substantially lower as well
mdp2021 9 hours ago https://taalas.com/h-content/uploads/2026/02/graph.png Gander5739 8 hours ago https://xkcd.com/1162/
So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq).
https://taalas.com/h-content/uploads/2026/02/graph.png
https://xkcd.com/1162/
im assuming energy expenditure is substantially lower as well