Comment by seanmcdirmid

True. Benchmarks have led me astray before, I'll have to actually benchmark it directly in Goose with my real use cases right now (which are mostly writing python code, so it probably still doesn't apply?). Still, I've never noticed a benefit to using a dense model rather than an MoE for coding with an agent tasks.