Comment by oars

Diminishing returns are currently seen in "transformer scaling laws."

"OpenAI’s CEO says the age of giant AI models is already over": https://news.ycombinator.com/item?id=35603756 (shared 3 dags after this post)

Let's see what the future holds.