Comment by j2kun
2 months ago
I don't see how "they improved the models" is related to the bitter lesson. You are still injecting human-level expertise (whether it is by prompts or a structured API) to compensate for the model's failures. A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference.
> A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference.
This is what I expected the post to be about before clicking.
The bitter lesson here is that it all goes back to natural language rather than lower level of abstractions
I would contest that this is not a "bitter lesson" in the sense that it has not been demonstrated repeatedly over decades as a truism of computer science.