Comment by naasking

> We're not gonna see significant model shrinkage until the money tap dries up.

I'm not sure about that. Microsoft has been doing great work on "1-bit" LLMs, and dropping the memory requirements would significantly cut down on operating costs for the frontier players.