Comment by simonw
1 day ago
Insider tips from Google and AWS telling me that they run inference at a profit (though that was over a year ago now).
Dario telling Dwarkesh three months ago that they have a margin on inference: https://www.dwarkesh.com/p/dario-amodei-2?timestamp=3528.0
Unless your insider is the CFO, I wouldn’t trust these sources to have the access, knowledge, or insight to determine whether they’re running inference at a profit.
Simple test: can they get their hands on a data center contracts and financials?
Search isn’t anywhere near as high profile as the profitability of AI inference, and yet, even aspects of the Search org were walled off from the rest of the company such that other employees couldn’t see what we see.
I don't think the fact that inference runs at a profit is a particularly deeply kept secret inside these companies.
It might be worth keeping it secret from the staff if they were running at a loss.
Are these sources not incentivized to say exactly this, regardless of whether it's true?
The insiders tips? I don't think so, they were people I trust.
They had all the incentive in the world to say "I'm not going to talk about that."