Comment by binwiederhier
7 months ago
In the video he shows that the font file size is 290GB, so I would assume that's a little prohibitive.
7 months ago
In the video he shows that the font file size is 290GB, so I would assume that's a little prohibitive.
That's LLaMa-3-70B. The demo he gives at 6:09 is tinystories-15m, which is 30.4MB, so you'd only have to add the font to that (80~KB?)
https://huggingface.co/nickypro/tinyllama-15M/tree/main
That’s only for a 70B param LLM. The one he includes is 15M params and weighs about 60MB. Not tiny, but doable.
That's smaller than Noto