Comment by ModernMech
4 days ago
If you spend $200 per month that's for X amount of work (represented as tokens) you can complete total. But if there are random resets then there's a different work maximization strategy. It's fine if you don't agree with it but it's not "crazy" behavior; it's completely rational to want to maximize a resource. It's not inventing work out of nowhere because there's more work to do than there are tokens in a week to do it. This is your assumption and why you've framed it as "crazy".
> it's completely rational to want to maximize a resource
Sure, in a video game where you have one attribute and you can minmax a strategy just focusing on that, but that's not how real-life works.
You can't just stack pending work on top of each other, expect yourself to be able to stay equally on top of everything and have the same results as if you didn't. With this comes the consideration about the tradeoffs of "produce mediocre but large body of works" vs "produce high quality but small body of works".
Who's to say what's more "rational" or not, it's not a straight-forward calculation which culminates in "Must consume all available usage to maximize resource usage" like some robot, as we are not.
It's quite literally inventing work out of nowhere as you wouldn't put the agent to do that and forcing yourself to be conscious about that work until it completes, unless you actually had the usage available. Asked another way, wouldn't your workflow clearly change if you had unlimited usage available? You'd probably attack tasks/problems that you didn't consider actually spending time/energy solving.
> With this comes the consideration about the tradeoffs of "produce mediocre but large body of works" vs "produce high quality but small body of works".
Not really. The AI will output the same sort of code at a certain skill level regardless of speed, it's not a human so the above is a false dichotomy. Also, it's sort of strange that you're saying it's inventing work out of nothing, you've never heard of a backlog? In companies that can grow very long and the more usage means the more that can be tackled.
> You'd probably attack tasks/problems that you didn't consider actually spending time/energy solving.
Yes? But that's probably after the backlog is complete unless they are truly low hanging or high priority fruit. So not sure how that reasons with your point.
> The AI will output the same sort of code at a certain skill level regardless of speed, it's not a human so the above is a false dichotomy.
It'll output the same code given the same prompts yes, but you don't just accept whatever it puts out, it requires iterations before it's actually ready to be committed as none of the agents write perfect code on their first try. So, it's not a "false dichotomy", I'm just looking at larger things than "LLM does inference"
1 reply →
Okay.