Comment by nolist_policy

Yes, The two couldn't be more different.

GPT-3 is probably one of the last models trained without synthetic data. Meanwhile gpt-oss is rumored to be only trained on synthetic data.

I also miss the 2020 GPT-3 based AI Dungeon fine tune.