Comment by a-dub
6 hours ago
the dynamics of discovery on a population level are also not fully understood. there's no doubt in my mind that the machines will grab all the low hanging fruit in terms of novel ideas through mechanical recombination of existing public science, and they will do so faster than humans can. what is not understood is whether they will plateau.
today they benefit from human willingness to share publicly and improve ai systems, but once those systems start to threaten their livelihoods, will those dynamics change? can the machines push the frontiers or is the global network of human creativity and tenacity necessary?
setting aside the dynamics question, it is known that LLMs have limits wrt the theorems they can prove without human input, see my comment here: https://news.ycombinator.com/item?id=49756412