Comment by flyinglizard

It takes a big leap of faith for real companies with a real P&L to hand out token budgets in the thousands far and wide across their teams. The ROI is very easy difficult to demonstrate.

I've been thinking about it a lot and I think there's going to be commoditization of tokens. No local models - the hardware to run at scale is too complicated for companies that are reluctant to even run a local file server - and not wholesale run to Chinese suppliers (due to IP considerations mainly).

I think the winners in the coding/office work space will be intermediaries who can sell reasonable quality tokens at cost plus. It's the same reason "real" companies don't hand out their employees fully decked Macbook Pros or don't provide $500k TC packages as a norm: they are fine with "good enough" and "good ROI". And that's not going to happen with Claude API pricing where it is.

Another field is API pricing for things that are not coding, like automated systems doing analysis of things. I think there it's a real race to the bottom, including - or even mostly - direct sourcing from China (just like business do with their real goods today).