Comment by jhonof
21 hours ago
> For one, on the margin people are willing to pay a lot for slightly better models. I know personally the value the LLM adds to my workflow is considerably more than the $200/m I pay the frontier labs. I have no interest in optimizing that to get it slightly lower. There are a very vocal minority that optimizes this or companies whose LLM expense is marginal, but I think that's the minority (correct me if I'm wrong, curious what their customer base looks like)
Enterprise is how Claude/OAI make their money. Enterprise companies absolutely optimize around costs for infra, it's like an entire job category.
> Also the actual LLM is a tiny portion of the value added. Anyone that tried to build agentic solutions from LLM apis quickly realizes that a huge value is the Claude Code / Codex harness. There are open source implementations like OpenCode but they're not nearly as good.
Claude and OAI are not valued at $1T because of their harnesses
> Think about it another way. Consider how much money Microsoft spends on maintaining Excel. There are open source alternatives that have >90% of the functionality, they'll even work w/ Excel files and generate them. Google sheets is probably 99% and available to everyone and better in a lot of regards. But the immense value spreadsheet software produces workers above the $100 or whatever a year makes it so that there is a real moat and no one bothers exploring alternatives.
Enterprise excel is like $50 a month, the closed source labs charge orders of magnitude more than that per user per month for enterprise, and want to charge more if they can to maintain their valuation. I spent $20 in an afternoon yesterday using my work plan for one workflow for reference, I probably spend at least $50 a day and I don't even do that much coding anymore.
$200/mo for 20x Max is great value - but it's not sustainable and won't last forever. Microsoft gave up. Anthropic will too. I use roughly $10k/mo - at that price it's absolutely not worth it.
I'm genuinely not sure where the balancing point even is.
Probably increasing learning rate have some value for these players which is enabled by subsidized usage.
And cost of acquiring learning via users feedback versus additional learning data value for a given company will dictate whether such company will give up or will continue subsidized usage, despite being unprofitable on the paper, but probably really valuable as a long term strategy for GTM and product development and increased learning rates.
> Claude and OAI are not valued at $1T because of their harnesses
They're valued at that because they add a lot of value and people pay for the product. The product is more than the LLM. If you want argue the value of the harness vs LLM but flippant remark adds nothing.
> Enterprise excel is like $50 a month, the closed source labs charge orders of magnitude more than that per user per month for enterprise, and want to charge more if they can to maintain their valuation. I spent $20 in an afternoon yesterday using my work plan for one workflow for reference, I probably spend at least $50 a day and I don't even do that much coding anymore.
I want to know what percent of their revenue is this API spend compared to just a Claude/Codex max plan that's $200/m and very generous.
I'd imagine it has to be immense. Most of the engineers I know are spending $200/day, let's say 20 workdays per month, $4000/mo. Whatever % of revenue it is, it's got to be close to 100% of profit.
Who is paying $200/day? My company has me on a $30/month plan (I assume they pay annually?). I use Claude constantly and only hit usage limits when I try to do 4+ projects at once.
I can't imagine why anyone would need almost 7x that.
2 replies →