Comment by jasonjmcghee 2 months ago Very interested to see the updated results. This could really shake up the leaderboard. 3 comments jasonjmcghee Reply blurbleblurble 2 months ago I hope it does. These coding benchmarks have often seemed frustratingly out of touch with my experience. typpilol 2 months ago The agentic ones seem better. Typescript is like at 25% last I saw on the models. Python was higher.That seems more accurate than the huge scores the other ones get 3abiton 2 months ago Because I would argue there is no benchmark to rule them all. It highly depends on individual use cases.
blurbleblurble 2 months ago I hope it does. These coding benchmarks have often seemed frustratingly out of touch with my experience. typpilol 2 months ago The agentic ones seem better. Typescript is like at 25% last I saw on the models. Python was higher.That seems more accurate than the huge scores the other ones get 3abiton 2 months ago Because I would argue there is no benchmark to rule them all. It highly depends on individual use cases.
typpilol 2 months ago The agentic ones seem better. Typescript is like at 25% last I saw on the models. Python was higher.That seems more accurate than the huge scores the other ones get
3abiton 2 months ago Because I would argue there is no benchmark to rule them all. It highly depends on individual use cases.
I hope it does. These coding benchmarks have often seemed frustratingly out of touch with my experience.
The agentic ones seem better. Typescript is like at 25% last I saw on the models. Python was higher.
That seems more accurate than the huge scores the other ones get
Because I would argue there is no benchmark to rule them all. It highly depends on individual use cases.