Comment by RussianCow
11 hours ago
The issue is that all input (including context) counts towards that limit. So 10 requests with 50k of context will blow through the limit, even if little to no output was generated, which is incredibly easy to do with agentic workloads.
No comments yet
Contribute on Hacker News ↗