Comment by emil-lp

2 months ago

The prompt was released, but not the cost of the result.

8 comments

emil-lp

Reply
riknos314  2 months ago

Assuming all 64 subagents were running for a full hour (the tweet states just under an hour):

  Throughput                    Output tokens   Output cost
  ----------------------------  -------------   -----------
  40 tok/s  (5.5 low)                   ~9.2M         ~$275
  55 tok/s  (5.5 base)                 ~12.7M         ~$380
  70 tok/s  (5.5 high)                 ~16.1M         ~$485
  750 tok/s (Sol Fast, $75/M)         ~172.8M       ~$13,000

Claude estimates that tool use / input tokens might add 10-15% on top of that depending on exactly how the model went about the task.

Edit: better tok/s estimate buckets based on GPT 5.5 actual speeds since I couldn't find real benchmarks on 5.6 published anywhere. Also account for Sol Fast pricing.

  • conradkay  2 months ago

    Sol fast isn't the Cerebras 750 tok/s version, it's just 1.5x speed at 2.5x price

    I assume they didn't use the Cerebras version for this since it's probably very supply-constrained right now

therobots927  2 months ago

And not how many times it was prompted before it returned a working solution.

Or how many prior variants of this prompt were tried.

Or if proof checking software was used to hone in on the final winning prompt / LLM output.