Comment by re-thc
8 hours ago
> I don't think cache read is a big portion of the overall cost.
For long running tasks it is. That's what made Deepseek so cheap.
8 hours ago
> I don't think cache read is a big portion of the overall cost.
For long running tasks it is. That's what made Deepseek so cheap.
Yeah, flash models, DeepSeek, MiMo, GLM, I love those things. For simple tasks like a daily routine shit, just setting up stuff and then doing the hard stuff in Claude/Codex, that's a reasonable approach for someone like me, a "gentleman code farmer", lol. And even lower tier stuff, I have the local models taking care of. Now that Jev is out I can finally have a true AI sysadmins managing my "cloud in the basement" homelab at the cost of electricity, which is not cheap btw