Comment by nrhrjrjrjtntbt

1. Choose set of code challenges (generate them, leetcode, AOC etc.)

2. LLM generates python solution and seperate python test (as in python test calls code as black box process so it can test non python code)

3. Agent using skills etc. tries to write new language let's call it Shark.

4. Run Shark code against test. If fails use agentic flows to correct until test passes.

5. Now have list of challenges, working code (maybe not beautiful) for training.

A bit of human spot checking may not go amiss!