Comment by user43928
3 hours ago
It wasn't so much an eval, I really just wanted a small change moved out to another branch.
GPT 5.4 mini couldn't do it. Not even on the second attempt, where it went from obviously wrong to a subtly wrong copy.
In the end I had to manually copy and paste the 10-20 lines over.
If it can't even do that job, I seriously doubt it's going to be adequate for implementing a plan, like people often seem to suggest it could do, in order to save output tokens of a better model.
No comments yet
Contribute on Hacker News ↗