← Back to context

Comment by gruturo

7 hours ago

Seconding this. Flash-next (and let's not forget, it's a PREVIEW of the 4 architecture - with the "real" 4 rumored coming later this month) is the first model I can run on reasonable hardware (2 thoroughly obsolete P100s off ebay at ~$100 each plus the RAM I could scavenge from other PCs at home) at a reasonable speed (22, with GPUs in layer-split due to llama-cpp's limitation on qwen4-exp arch, and no MTP. Strata could double these numbers).

It's.... the real thing, for the first time. If you cut me off cloud models today, I would get plenty of utility out of this thing.

(Others may have had the same feeling from GLM5.3 or Deepseek 4.1 flash but I never had a chance of running those.)