Comment by jtfrench

12 hours ago

Or maybe we’d have LLMs that fit in a handful of GBs (and we technically already do). It’s hard to tell without completely going down that parallel universe and simulating all the milestones in it, but it’s a fun thought experiment.

There is likely no way to have a decent LLM fit in a handful of GB and be as useful as the frontier ones we have today.