← Back to context

Comment by Amekedl

1 hour ago

Would love to see the author actually go deeper into details: what did they eval with models implementing zstd?

Many such cases are benign in the sense they in practice are simply the model basically "git clone"-ing the code they need to complete the implementation.

The amount of recall and synthetic data slop makes it imho very hard to actually get the models to really do something more novel (where they fall apart more often)