Comment by thethimble
3 days ago
Separately, you have to consider that "wasting tokens spinning" might be acceptable if you're able to run hundreds of thousands of these things in parallel. If even a small subset of them translate to value, then you're far net ahead vs with a strictly manual/human process.
> hundreds of thousands of these things in parallel
At what cost,. monetary and environmental?
If the system provides value that is greater than its cost, then paying the cost to gain the value is always worthwhile - regardless of the magnitude of the cost.
As costs drop exponentially (a reasonable expectation for LLMs, etc.) then increasing agent parallelism becomes more and more economically viable over time.
>As costs drop exponentially
Not a reasonable expectation anymore. Moore's Law has been dead for more than a decade and we're getting close to physical limits.