I'd argue that meaningful sequences of symbols constitute a language. This example doesn't use a human language but it does use a language IMO (at least AFAIU).
I don't understand what you're saying? An LLM is a transformer model trained on a large corpus of natural language, often with some post-training. An image model is a different type of transformer model. What's controversial here?
Your example is a meaningless sequence. So consider a different scenario where the sequence is meaningful but does not map to any human language. What exactly disqualifies it as a non-human language?
When you encounter a human language that you can't personally read presumably you don't proceed to claim that it doesn't constitute language on the basis of your own lack of ability.
To come at it from a slightly different angle - does compiled binary code count as a language? If not, why not? (I'll suggest that it's a language albeit not a natural one.)
Any sequence could be meaningful or meaningless depending on the grammar involved. Open a word document in photoshop and the program has no idea what it’s dealing with.
The reason the language term in LLM is meaningful is how the training, symbol mapping, etc is designed around human languages. The model doesn’t process raw text, instead there’s a critical processing step which allows the magic to happen.
> The distinction is meaningless IMO.
Not when discussing whether it's an LLM. The second L in LLM does have a meaning.
I'd argue that meaningful sequences of symbols constitute a language. This example doesn't use a human language but it does use a language IMO (at least AFAIU).
Are number sequences a language?
1 reply →
[flagged]
You're the first! Congratulations.
Sure, and those aren't LLMs?
[flagged]
I don't understand what you're saying? An LLM is a transformer model trained on a large corpus of natural language, often with some post-training. An image model is a different type of transformer model. What's controversial here?
Words and symbols alone don’t make a language.
Zipper and and? and coin is pimple, Ocean! run bumper.
Your example is a meaningless sequence. So consider a different scenario where the sequence is meaningful but does not map to any human language. What exactly disqualifies it as a non-human language?
When you encounter a human language that you can't personally read presumably you don't proceed to claim that it doesn't constitute language on the basis of your own lack of ability.
To come at it from a slightly different angle - does compiled binary code count as a language? If not, why not? (I'll suggest that it's a language albeit not a natural one.)
Any sequence could be meaningful or meaningless depending on the grammar involved. Open a word document in photoshop and the program has no idea what it’s dealing with.
The reason the language term in LLM is meaningful is how the training, symbol mapping, etc is designed around human languages. The model doesn’t process raw text, instead there’s a critical processing step which allows the magic to happen.
3 replies →
[flagged]
LLMs also don't use words
Yes, but they're models of _language_ - words in, words out. The fact that they're embedded to vectors does not change this.
This is incredibly pedantic if you ask me.