Comment by flir
1 year ago
Suggestion: Now take the code away, and have the chatbot generate code that passes the tests it wrote.
(In theory, you get a clean-room implementation of the original code. If you do this please ping me because I'd love to see the results.)
That’s sort of interesting. If code -> tests -> code is enough to get a clean room implementation, really, I wonder if this sort of tool would test that.
I don't think it is, but I'm really interested to see someone try it (I'm also lazy).
(And a more philosophical question: if it's not enough, what does that mean for continuous deployment?)