Comment by glouwbug

This is what Anthropic did with agents and $20k to write a C compiler that survived gcc’s torture suite. But the LLM knew:

1. What a C compiler was

2. What a C compiler looked like

3. What the C compiler had to do at runtime to pass gcc’s torture suite through some sort of collaborative iteration (compile, run, did it get stuck at some torture suite test or fail?)

Remove 1 and 2, or replace it with imperfect business logic, and you’re left with a system that is built to _only_ pass the tests you supply it, or in the most extreme case, print(“unit and functional tests pass!”)