← Back to context

Comment by charcircuit

3 days ago

GPT wouldn't have even been possible, let alone take off, without self supervised learning.

RLHF is what gave us the ChatGPT moment. Self supervised learning was the base for this.

SSL creates all the connections and RL learns to walk the paths

  • The easy to use web interface gave us the ChatGPT moment. Take a look at AI Dungeon for GPT2. It went viral due to making using GPT2 accessible.