Comment by lostmsu
3 days ago
GPT-2 (2019) https://openai.com/index/better-language-models/
Forever reinforced by Humans Who Are Not Concentrating Are Not General Intelligences: https://srconstantin.wordpress.com/2019/02/25/humans-who-are... one week later.
It's a great post. Or as Scott Alexander put it at the time:
> A machine learning researcher writes me in response to yesterday’s post, saying:
>> I still think GPT-2 is a brute-force statistical pattern matcher which blends up the internet and gives you back a slightly unappetizing slurry of it when asked.
> I resisted the urge to answer “Yeah, well, your mom is a brute-force statistical pattern matcher which blends up the internet and gives you back a slightly unappetizing slurry of it when asked.”
> But I think it would have been true.
https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-g...