Comment by kartoolOz
2 years ago
Technical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_... Nano-2 is 3.25b, and as per figure 3, nano-2 is roughly 0.6-0.8 as good as pro, and ultra is 1.05-1.3 as good as pro.
Roughly that should put gemini ultra in the sub 100b range?
Those calculations definitely do not scale linearly