Comment by minimaxir
2 days ago
A month ago I wrote a blog post about how Hy3 was topping the OpenRouter rankings despite no one talking about it: https://openrouter.ai/deepseek/deepseek-v4-flash
2 days ago
A month ago I wrote a blog post about how Hy3 was topping the OpenRouter rankings despite no one talking about it: https://openrouter.ai/deepseek/deepseek-v4-flash
I had to stop using it because I was getting rate limited like crazy. Probably why it has dropped. Seemed like they couldn't keep up with demand.
Because it was free with generous limits and high availability, until it wasn't.
That was the preview model right? This one appears to be significantly better.
I mean it's still a small model, but at least the benchmark scores (incl. on DeepSWE) went up significantly.
It costs as much as Flash, but the benchmarks are on par with Pro (or above in some cases).
Of course, benchmarks are mostly meaningless -- the only real benchmark is the actual work you give it :)
It is really slow on openrouter and I ran into many http errors.
Writes pretty engaging prose, finetunes well, now MIT licensed... what's not to like?
Oh and very good world knowledge for the size: better than than DS4 Flash
Do people really use 100B+ models for writing? I am no writer but to me it seems like writing is one of the easiest tasks with barely any logic or reasoning and as long as its not longer than a handful of pages I expect even 8B models to perform great.
It's pretty clear you've never experimented with it. Creative writing demands everything the model can do and more, and most problems are still unsolved. It's extremely heavy reasoning-wise, more so than coding (check e.g. Engram paper for some insights), but also needs good scattered retrieval, careful subjective training for prose quality, character, and human likeness, a ton of facts baked in, and much much more. Mode collapse is not solved. No LLM does creative writing well but historically only the absolute largest models were able to do write anything complex more or less convincingly and were creative enough.
> I am no writer but to me it seems like writing is one of the easiest tasks with barely any logic or reasoning
Virtually all logic or reasoning is, in one way or another, part of the support for writing. It’s what separates actual writing from generating nonsense that happens to fit grammar rules.
The specific details depend on the domain, of course, but I can’t see how anyone familiar with the output of writing can think that there is little logic or reasoning in doing it well.
4 replies →
> with barely any logic or reasoning
I take it you enjoy works of literature with inconsistent world building?
Or do you mean professional as opposed to creative writing? Because the bar is even higher for that.
2 replies →
The largest model I've post-trained in the last 2 years of working on this problem was Kimi 2.5 at 1T parameters.
The simplest way I'd put it is, teaching a model to write coherently (follow rules, patterns, etc.) is easy enough: just use teacher forcing. Teaching a model to write creatively is easy enough: just use RL and punish it for not being creative.
Teaching a model to write well and creatively takes learning two partially opposing objectives that spike the learning requirements in ways that smaller models really struggle with.
5 replies →