Comment by nl
3 days ago
Is 4 TPS actually useful for anything?
That's around 350,000 tokens in a day. I don't track my Claude/Codex usage, but Kilocode with the free Grok model does and I'm using between 3.3M and 50M tokens in a day (plus additional usage in Claude + Codex + Mistral Vibe + Amp Coder)
I'm trying to imagine a use case where I'd want this. Maybe running some small coding task overnight? But it just doesn't seem very useful.
3.5-50M tokens a day? What are you doing with all those tokens?
Yesterday I asked Claude to write one function. I didn't ask it to do anything else because it wouldn't have been helpful.
Here’s my own stats, for comparison: https://news.ycombinator.com/item?id=46216192
Essentially migrating codebases, implementing features, as well as all of the referencing of existing code and writing tests and various automation scripts that are needed to ensure that the code changes are okay. Over 95% of those tokens are reads, since often there’s a need for a lot of consistency and iteration.
It works pretty well if you’re not limited by a tight budget.
https://github.com/nlothian/Vibe-Prolog chews a lot of tokens.
Have a bunch of other side projects as well as my day job.
It's pretty easy to get through lots of tokens.
I only run small models (70b at my hardware gets me around 10-20 TOPS) for just random things (personal assistant kind of thing) but not for coding tasks.
For coding related tasks I consume 30-80M tokens per day and I want something as fast as it gets