← Back to context

Comment by kristopolous

15 hours ago

That M versus B is way too subtle. 0.026B is my suggestion

The "M" nomenclature has been around since at least BERT and T5/FLAN. It's valid to use it even if today's LLM devs are more familiar with billion-scale models.

I was so confused by many comments in this post but thanks to you I realized that some people are apparently reading it as 26B and that's why their comments make no sense.

[flagged]