Comment by jrflo
9 hours ago
That's not really that ridiculous. Looking at my ChatGPT stats my biggest day of token usage was 1B tokens (seeing how far Sol Ultra could go on a difficult problem with a quantitative goal and eval harness that it could run on it's own that allowed it to keep going until it succeeded). I blew through my $100 subscription usage in that one day, but with a 80/20 token blend that's $10k in API billing. So, $70k in a week. With the higher cost of Mythos, that's not that crazy. It's more so a testament to how ridiculously marked up API tokens are, or how discounted subscriptions are (who knows which is true)
Is that including cache reads? It seems improbable that (a) you actually filled 1000 1M contexts and (b) OpenAI allowed that in a $100 subscription window.
How much was valuable the output you got during the day?
Is it at least comparable to the $10k of cost?