Comment by dannyw

World knowledge, factual recall without grounding, more complex instruction following, etc.

Benchmarks don’t really tell you much. For API best will always be a model+effort sweep on your internal evals (and if you don’t have internal evals, do that first).

For individual coding harnesses, honestly I just go with vibes. The best workflow is the one that works for you.