Comment by 1dom

> LLMs which the weights aren't available are an example of when it's not local LLMs, not when the model happens to be large.

I agree. My point was that most aren't thinking of models this large when they're talking about local LLMs. That's what I said, right? This is supported by the download counts on hf: the most downloaded local models are significantly smaller than 1tln, normally 1 - 12bln.

I'm not sure I understand what point you're trying to make here?