Comment by vendiddy
1 year ago
Somewhat related - I wonder if LLMs are trained with a compiler in the loop to ensure they understand the constraints of each language.
1 year ago
Somewhat related - I wonder if LLMs are trained with a compiler in the loop to ensure they understand the constraints of each language.
This is a good idea. You could take a set of problems, have the LLM solve it, then continuously rewrite the LLM's context window to introduce subtle bugs or coding errors in previous code submissions (use another LLM to be fully hands off), and have it try to amend the issues through debugging the compiler or test errors. I don't know to what extent this is already done.