Comment by BenzeneDream
1 day ago
Why would it freeze if they can create more training material. Its already been shown synthetic training data is just as good if not better.
1 day ago
Why would it freeze if they can create more training material. Its already been shown synthetic training data is just as good if not better.
> Its already been shown synthetic training data is just as good if not better.
Source, please! I'm a machine learning layperson but how can this not be overfitting?
For example, an LLM can prove a new theorem in math, verify it in Lean (so it is definitely true), and then prove more things based on that.
AI-generated data might not always be that useful, but at least in this case it obviously is.
https://arxiv.org/html/2609.26457v1
> AIDE demonstrates that recursive self-improvement at the harness layer can produce transferable gains in an AI research agent’s research efficiency. During the recursive self-improvement run, the loop accepted seven rewrites, each under a fixed evaluation budget (section 3.2). Under this fixed evaluation budget, gains in optimization capability on AI R&D tasks translate to gains in research efficiency."
https://arxiv.org/abs/2609.11873
> The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
[dead]