← Back to context

Comment by porridgeraisin

14 hours ago

agy is good for those cases where you are willing to put the effort into the harness specifically for a task or family of tasks. The full suite, with evals, monitoring, hooks, custom tools, custom verifiers, etc,. It is not good if you want a "general coding assistant" like codex or claudecode.

The reality is that if you optimise a harness for a family of tasks[1], then most of these models give successful output. And there, gemini flash's speed shines.

For general coding assistant, you want it to be well, general, and you use a harness without too much customisation to something specific. Here you need deeply post trained coding assistants and implementors like codex/sol or claude/opus. Gemini flash in its current form will be too happy-go-lucky if you try using it the way we all use codex and is better used in a constrained setting.

tl;dr gemini flash for "LLM-aided workflows in production" is super good today. Cheap as well.

[1] Stuff like this: https://antigravity.google/blog/teamwork-when-ai-becomes-a-r...

https://hamel.dev/notes/llm/evals/