Comment by energy123
5 days ago
Jacob Tsimerman believes that AI will be better than human mathematicians within 2 years.
We should not be surprised if AI solves the Millenium problems very soon and advances to a level that is barely comprehensible, or even incomprehensible, to the best humans.
We can expect this not by curve fitting to recent progress but by reasoning from first principles about where the progress has come from (synthetic data, non-human corpus) that has no obvious upper bound on capabilities.
The obvious and primary application will not be on showy millennium problems or long sought conjectures, but on optimizations and breakthroughs surrounding transformers.
We are doing fine so far with just Transformers, we have just crossed Trillion parameter models, we don't know if 100s of Trillion param model wont be better.
The breakthroughs would be mostly in optimizations for computing tokens, not as much in expanding parameter count (if anything we want to shrink that).
[dead]