Comment by cold_harbor
4 hours ago
fair point — OpenAI's original plan literally said "solve unsupervised learning". the self-supervised distinction wasnt really standard til after BERT/GPT popularized it
4 hours ago
fair point — OpenAI's original plan literally said "solve unsupervised learning". the self-supervised distinction wasnt really standard til after BERT/GPT popularized it
I think it's an extremely important distinction because self supervised learning has real inherent reward signals. Something like clustering does not.