Comment by nightski 16 hours ago My DGX spark cluster is humming along. 9 comments nightski Reply dist-epoch 15 hours ago I've used 200 mil tokens of GPT-5.6 Sol today. How many can your cluster produce per day? (obviously of whatever model you are running) nightski 15 hours ago So you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :) dist-epoch 15 hours ago No, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached. 2 replies → panarky 15 hours ago What are we optimizing for again? guessbest 15 hours ago Internet comments cartermatic 15 hours ago Shareholder value 1 reply →
dist-epoch 15 hours ago I've used 200 mil tokens of GPT-5.6 Sol today. How many can your cluster produce per day? (obviously of whatever model you are running) nightski 15 hours ago So you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :) dist-epoch 15 hours ago No, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached. 2 replies → panarky 15 hours ago What are we optimizing for again? guessbest 15 hours ago Internet comments cartermatic 15 hours ago Shareholder value 1 reply →
nightski 15 hours ago So you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :) dist-epoch 15 hours ago No, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached. 2 replies →
dist-epoch 15 hours ago No, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached. 2 replies →
panarky 15 hours ago What are we optimizing for again? guessbest 15 hours ago Internet comments cartermatic 15 hours ago Shareholder value 1 reply →
I've used 200 mil tokens of GPT-5.6 Sol today. How many can your cluster produce per day? (obviously of whatever model you are running)
So you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :)
No, I spend $200 per month, and this give me about 100 mil tokens per day, every day. 90+% of tokens are cached.
2 replies →
What are we optimizing for again?
Internet comments
Shareholder value
1 reply →