Comment by conradkay

Interesting comparison, thanks for sharing! It reminds me of this post about how machine learning and encryption have some fundamental similarities: https://reiner.org/neural-net-ciphers

> I can certainly imagine LLMs taking a similar path. Maybe it's useful to think about what fundamental differences could contribute to LLMs taking a very different path. What comes to mind is the scaling hypothesis, implying that the best LLMs will require enormous capital investment.

That seems largely incompatible with open source barring a fundamental change. There's open weights, but I can't think of a clean historical analogy there and find it extremely difficult to even guess how the future will go