Comment by WarmWash
5 days ago
The obvious and primary application will not be on showy millennium problems or long sought conjectures, but on optimizations and breakthroughs surrounding transformers.
5 days ago
The obvious and primary application will not be on showy millennium problems or long sought conjectures, but on optimizations and breakthroughs surrounding transformers.
We are doing fine so far with just Transformers, we have just crossed Trillion parameter models, we don't know if 100s of Trillion param model wont be better.
The breakthroughs would be mostly in optimizations for computing tokens, not as much in expanding parameter count (if anything we want to shrink that).