Comment by wesammikhail
21 hours ago
I've seen sources like this before. It's all hearsay and promo. I was asking for any publicly available verifiable information regarding the cost of inference at scale. I haven't seen any such info personally which is why I asked.
I'm dying to see S-1 filing for Anthropic or OpenAI. I don't actually think inference is as cheap as people say if you consider the total cost (hardware, energy, capex, etc)
Well they're not public yet so you'll have to put up with rumors. But the numbers are available for companies like DeepSeek say they have an 80% profit margin, so it stands to reason OAI etc would do similar numbers considering they charge much more.
AFAIK,
1. the 80% margin from 2025 was theoretical,
2. they're relying on distillation/synthetic data for training,
3. and have been very opaque about cross-subsidization of R&D with their models.
The distillation alone adds a big asterisk for comparisons.
Talking nonsense.
1 reply →