← Back to context

Comment by rdli

2 hours ago

Yes. It spawned multiple subagents to run different experiments to benchmark a lot of different things, reviewed CI logs from past runs, etc. In the end, there were changes to what/how we cached, various code quality checks, speeding up test runners, and many other things.

I dare not ask about the cost, having burned $60 on a task running for 1h 16min once.

  • I’m on the $100/month subscription; this session took about $500 in token-equivalent costs.

    (Note that it wasn’t all Opus 5.5; I have a setup that uses Fable 5.1 as an advisor, Sonnet 5.5 for mechanical changes, etc.)

    • God I hope the prices drop quick. Once they stop subsidizing it these kinds of workflows will be unaffordable for anyone who isn't already wealthy

      1 reply →

    • Does it resume automatically on higher subscriptions?

      I'm on a $20 plan and it never auto resumes. I have to go back in and type out resume or click a button.

      3 replies →

  • If you compare the cost to the price of dinner or whatever else you spend disposable income on, it can seem high but if you compare the cost to employing an engineer (don’t forget costs for payroll taxes, office space and equipment, etc) and consider the fact that the models often seem to be much faster than even expert humans, the costs don’t seem so terrible.