Comment by regularfry

Nah. There are already models at every size on the scale. If you want to run an open 1T model today, you can.

What's going to happen is that the capability at any given size point is going to get better over time as new training regimes cram more into the available space. A 27b model released next year will be better than a 27b model this year (else why release it?). Hardware will get more useful, not less.