Comment by scosman
2 hours ago
Why assume finite token budgets? Scaling 2x tokens isn’t a major jump if it brings quality.
Also the GPUI approach is still finite tokens, just better stack.
2 hours ago
Why assume finite token budgets? Scaling 2x tokens isn’t a major jump if it brings quality.
Also the GPUI approach is still finite tokens, just better stack.
Because any kind of budget, resources are always finite? 2x the tokens roughly translates to 2x the cost. That’s a pretty big ask. Quality alone, unfortunately, isn’t always enough to justify it. There has to be business value too.