Comment by mycall

I think something similar to Self-Adapting Language Models will automate this task soon.

https://arxiv.org/pdf/2506.10943