Comment by anotherpaulg
2 years ago
I mean, of course I tried just asking GPT to not be lazy and write all the code. I quantitatively assessed many versions of that approach and found it didn't help.
I implemented and evaluated a large number of both simple and non-trivial approaches to solving the coding laziness problem. Here's the relevant paragraph from the article I linked above:
Aider’s new unified diff editing format outperforms other solutions I evaluated by a wide margin. I explored many other approaches including: prompts about being tireless and diligent, OpenAI’s function/tool calling capabilities, numerous variations on aider’s existing editing formats, line number based formats and other diff-like formats. The results shared here reflect an extensive investigation and benchmark evaluations of many approaches.
Did you try telling it that being lazy is futile in the manner I described? That is a major improvement over just telling it to return complete code. I've gotten chatgpt to spit out >1k lines of complete code with that, using just "return complete code" will cause it to try and find ways to answer a subset of the question "completely" to appease its alignment.