← Back to context

Comment by MattDaEskimo

2 months ago

How is it misleading if this would be the consumer's cost?

Eventually Codex's subscription subsidization will diminish to near-zero, like the rest of the providers.

It's extremely important that people understand how expensive these models currently are. Even $300k in raw API costs is alarming for the output.

> How is it misleading if this would be the consumer's cost?

Because it does not say “equivalent of”, it literally says he spent money that he did not spend

  • If anything it cost more than the title, because customer costs are wildly subsidized.

    So yeah its misleading but in the other direction.

    • Inference is highly marked up. Total costs including training may be subsidized (,in a sense since the AI companies are widely reported to not break even as yet)

We know how expensive the (Chinese) models are to run, because there are a hundred inference providers selling them cheaply and competitively.

The money going to the American model companies is not going to their hosting costs.

Peter shows the near-term future. Raw API consumer price cost is arbitrary. (The frontier labs can put a 100x markup to cover other operational expenses.) The true cost of inference with same-capability models keeps dropping at dizzying rates, especially at the data-center batch size. (Due to both NVidia hardware and algorithmic changes.) So the developments that Peter can achieve today with internal support from OpenAI will be doable by anyone in a few years without breaking the bank.

  • But.... why? Like I read his thing on how he spends the tokens [0] and it sounds like satire.

    He has agents write shitty code for features other agents think other people want, then has it reviewed by other agents in hopes of catching bugs that the first agent put there, then has some more agents try to find security bugs in the now double-agented code to make it triple-agented and at the end of the day, he spent a shitton of tokens, probably emitted enough carbon to heat our planet by another degree, and has a feature nobody really asked for that might or might not work.

    He then has the sense of humor to call this grotesque process "incredibly lean".

    What's the point in all of this? What problems is this solving? Who's benefiting?

    [0] https://xcancel.com/steipete/status/2055405041843052792

    • I don’t use openclaw myself anymore, but this agonizing is thin and unbearable. He did a thing. People use the thing. He got paid for the thing. He iterates the thing. What’s hard to understand about this?

      The morality issues about consumption climate impacts are not his alone, and are not unique by itself to his endeavor. Every company with an enterprise LLM agreement has a share, for instance.

      8 replies →

    • >He then has the sense of humor to call this grotesque process "incredibly lean".

      > What's the point in all of this? What problems is this solving? Who's benefiting?

      The economy doesn't work like how you think it does. Its not central planning. All the usages aren't detailed in a specification, submitted for approval to 100 agencies and then allowed to be used.

      It shows lack of intellectual curiosity to not engage deeply with obviously profound technology and what the implications are. I find this exercise helpful.

      Peter is predicting how LLMs will be used in the future when the prices go down. And they will definitely go down. I think his predictions are correct and we will definitely have something similar to OpenClaw.

      5 replies →

    • But this is okay?

      “He has /people/ write shitty code for features other /people/ think other people want, then has it reviewed by other /people/ in hopes of catching bugs that the first /people/ put there, then has some more /people/ try to find security bugs in the now /double-peopled/ code to make it /triple-peopled/ and at the end of the day, he spent a shitton of /money, the people/ probably emitted enough carbon to heat our planet by another degree, and has a feature nobody really asked for that might or might not work.”

      Honestly sounds like a normal tech company to me. Just with much dumber “people” who are getting exponentially smarter, eventually never die, eventually never forget.

      You have to skate to where the puck is going, not where it is.

      5 replies →

  • Peter shows shit. What did Peter meaningfully achieve? What additional revenue is he creating? ah yes - shit and more shit on all accounts as it seems.