Comment by tyre
15 hours ago
Why would you need an M4 for this? If most of the "thinking" is happening on Anthropic's side, are you running particularly resource-intensive apps?
15 hours ago
Why would you need an M4 for this? If most of the "thinking" is happening on Anthropic's side, are you running particularly resource-intensive apps?
The gpu inference happens on anthropics side, but the output of the gpu inference is often many local tool calls. The agent is locally reading files, writing files, compiling programs, downloading artifacts, running tests, invoking CLIs, monitoring logs, inspecting web sites, grepping etc, and can be doing all of that at once, in parallel via subagents, much faster than a single human ever could.