Comment by abdullin
4 days ago
I grew to like migration projects like that.
Currently working on migration of 30yo ERP without tests in Progress to Kotlin+PostgreSQL.
AI agents don’t care which code to read or convert into tests. They just need an automated feedback loop and some human oversight.
I would argue that they need heavy human oversight
For sure; I'll believe that an AI can read and "understand" code, extract meaning and requirements from it, but it won't be the same as a human that knows requirements.
Then again, a human won't know all requirements either; over time, requirements are literally encoded.
In systems like that you can record human interactions with the old version, replay against the new one and compare outcomes.
Is there a delta? Debug and add a unit test to capture the bug. Then fix and move to the next delta.