Comment by golol
2 years ago
In my opinion the field is not that rapidly advancing. The major breakthroughs, where something was really much better than everything before were the following:
GPT-2 February 2019
GPT-3 June 2020
CPT-3.5 December 2022
GPT-4 February 2023
Note that GPT-3 to GPT4 took almost 3 years!
That seems like a pretty remarkable pace of innovation, no?
Yea but some people seem to expect that GPT-4 should follow soon after GPT-4 because GPT-4 followed soon after ChatGPT.
GPT-4 was done training 8 months before release, so 2 years