Comment by lotrg

Agree with you, I do

Language modeling is fundamentally compression: https://arxiv.org/abs/2309.10668

The entire endeavor is ultimately fundamentally coupled to reducing compute

Eventually we will compress models further by removing outdated knowledge like Python and Cobol cause who needs 1960s like languages to then layout data in the screen when the model has knowledge of geometry and can mutate the screen geometry without needing a Python interpreter or C compiler