← Back to context Comment by rayiner 10 hours ago Oh my god did we inadvertently train AIs on idiotspeak. 8 comments rayiner Reply canucker2016 7 hours ago It seems to be called the Rule of 3. see https://en.wikipedia.org/wiki/Rule_of_three_(writing)Like Caesar's supposed "Veni Vidi Vici" saying, people seem to prefer and remember items when grouped in three.I recall a public speaking film shown to my management science class starring John Cleese mentioning this rule of 3. Exoristos 4 hours ago There was nothing inadvertent about it. A decade of cultivating and harvesting millions of examples of this kind of pseudo-writing from underpaid internet piece-workers preceded LLMs. Sharlin 7 hours ago Given that this specific style is the result of being reinforced over and over again via RLHF, "inadvertently" isn't really the word I'd use. LearnYouALisp 10 hours ago In-advert-ently? 12_throw_away 8 hours ago > did we inadvertently train AIs on idiotspeak.Nope! That is - training on lowest-common-denominator, low-signal high-noise "idiotspeak" was not at all inadvertent. andrepd 6 hours ago No, we actually trained it on standardised tests https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li... BoredPositron 8 hours ago It's engaging and I doubt it happened by accident. slowmovintarget 6 hours ago * Checks notes *RedditTwitterFacebook4chanCall of Duty chat logsEvery public marketing siteSlashDotUseNet...Verdict: Yes idiotspeak was part of the training set, but no, it was not inadvertent. There's a smattering of Shakespeare in there, at least.
canucker2016 7 hours ago It seems to be called the Rule of 3. see https://en.wikipedia.org/wiki/Rule_of_three_(writing)Like Caesar's supposed "Veni Vidi Vici" saying, people seem to prefer and remember items when grouped in three.I recall a public speaking film shown to my management science class starring John Cleese mentioning this rule of 3.
Exoristos 4 hours ago There was nothing inadvertent about it. A decade of cultivating and harvesting millions of examples of this kind of pseudo-writing from underpaid internet piece-workers preceded LLMs.
Sharlin 7 hours ago Given that this specific style is the result of being reinforced over and over again via RLHF, "inadvertently" isn't really the word I'd use.
12_throw_away 8 hours ago > did we inadvertently train AIs on idiotspeak.Nope! That is - training on lowest-common-denominator, low-signal high-noise "idiotspeak" was not at all inadvertent.
andrepd 6 hours ago No, we actually trained it on standardised tests https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li...
slowmovintarget 6 hours ago * Checks notes *RedditTwitterFacebook4chanCall of Duty chat logsEvery public marketing siteSlashDotUseNet...Verdict: Yes idiotspeak was part of the training set, but no, it was not inadvertent. There's a smattering of Shakespeare in there, at least.
It seems to be called the Rule of 3. see https://en.wikipedia.org/wiki/Rule_of_three_(writing)
Like Caesar's supposed "Veni Vidi Vici" saying, people seem to prefer and remember items when grouped in three.
I recall a public speaking film shown to my management science class starring John Cleese mentioning this rule of 3.
There was nothing inadvertent about it. A decade of cultivating and harvesting millions of examples of this kind of pseudo-writing from underpaid internet piece-workers preceded LLMs.
Given that this specific style is the result of being reinforced over and over again via RLHF, "inadvertently" isn't really the word I'd use.
In-advert-ently?
> did we inadvertently train AIs on idiotspeak.
Nope! That is - training on lowest-common-denominator, low-signal high-noise "idiotspeak" was not at all inadvertent.
No, we actually trained it on standardised tests https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li...
It's engaging and I doubt it happened by accident.
* Checks notes *
Reddit
Twitter
Facebook
4chan
Call of Duty chat logs
Every public marketing site
SlashDot
UseNet
...
Verdict: Yes idiotspeak was part of the training set, but no, it was not inadvertent. There's a smattering of Shakespeare in there, at least.