Comment by selcuka

It's a quantised 8B model (Llama 3.1 8B to be exact).

[1] https://taalas.com/the-path-to-ubiquitous-ai/