Comment by krzyk
3 days ago
Using local models or external?
If external, aren't they pricey? How much tokens they generate?
If local, what runs on such hardware that gives reasonable results?
3 days ago
Using local models or external?
If external, aren't they pricey? How much tokens they generate?
If local, what runs on such hardware that gives reasonable results?
Local models on different machines with multiple RTX Pro 6000 or multiple DGX Sparks or a 512GB RAM Macstudio; the agents themselves run on that Pentium J NUC and just use exposed endpoints for local models. Forgejo for Git runs on another server. Therefore I don't really care if that NUC goes kaboom and can test everything quickly (OpenClaw, Hermes, Claude Code, Codex, OpenCode, Pi etc.). Or I can just use OpenRouter API key and access 10-100x cheaper models than Opus.