← Back to context

Comment by edot

3 hours ago

14 seconds per token? Not tokens per second. Seconds per token? That’s nowhere near the cusp!

It's need it to be an order of magnitude cheaper, but for some queries ("What to discuss at tomorrow's meeting") I can wait 12+ hours.

At that rate, it would take me a mere 15 days to generate the number of tokens I typically use in a day.

"Yes, I'm using AI to speed up development. I'll submit that PR in two weeks time!"