← Back to context

Comment by manquer

2 hours ago

You can use your preexisting committed spends for GCP on Open AI, i.e. if an enterprise 10M/year contracted spends for first party GCP services, now they can also use that on OAI models hosted on GCP.

Meaning they can swap out compute/storage spends on GCP to LLM model spend or use left over budget ( which would go waste anyway ) and so on . Any OpenAI sales by GCP teams would be considered against their quota typically in this type of arrangement [2]

This is normally not done to third party[1] marketplace services, Azure already does this for OpenAI, it helps drive some enterprise spends as it is from for fungible budgets or different approving authority internally in a org when it is not a new vendor, new budget etc.

----

[1] It is not too hard to get into these types of programs i.e. it not only for OpenAI level partners mid sized startups can also be part of these deals in marketplace, the requirement usually is minimum size and the partner having to prove/show that are spending that customer's revenue on the compute etc so money is going back to them, then AWS/Azure/GCP will consider an org for this type of program.

Given that GCP is hosting these models on their cloud and therefore OpenAI is spending a % of every dollar back on GCP for every token sold like this; it wouldn't have been too hard for OpenAI to got such a program even if they were a mid sized startup.

[2] Multiples maybe involved (also used to push some first party products) 1x would 1M in OAI sales counts as 1M in their Qtr/annual targets 0.5x would mean 500k and 5x means 5M quota would be retired for 1M in sales etc.

So when cloud deals are signed, it is with a spending figure? Do you get discounts if it is a large number?

Thanks for you reply, it was very enlightening