This is speculation, but funnily enough Gemini models show the least evidence of being distilled from OAI or Anthropic compared to everything else in the market.
I feel this is correct. Google has probably the most data of any company in the world. For better or worse, they don't need to train on the outputs of other models.
At a org like Google Cloud barring rogue L5/6/7s acting on their own any sniffing of distillation will get leaked. Too many chaos exist at a org size of Google to systematically do it given the contract at hand. This is a company where every spicy memo or mild gossip will risk leaks.
Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live
I don't believe threat of litigation alone explains the extent of it.
The way an American company, esp a reputable one like Google, conducts itself internally is different. There will be much more internal backlash to do the wrong thing way before litigation.
This is speculation, but funnily enough Gemini models show the least evidence of being distilled from OAI or Anthropic compared to everything else in the market.
I feel this is correct. Google has probably the most data of any company in the world. For better or worse, they don't need to train on the outputs of other models.
At a org like Google Cloud barring rogue L5/6/7s acting on their own any sniffing of distillation will get leaked. Too many chaos exist at a org size of Google to systematically do it given the contract at hand. This is a company where every spicy memo or mild gossip will risk leaks.
GCP already hosts Anthropic models so probably trusts and lawyers.
Probably a very strict contract, and letting OpenAI read all the session logs like they do for their own customers.
Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live
Isn't distillation more of a black box type affair?
Distillation does not require access to weights.
Doesn’t really matter what happens at the GPU level when Google can see all API traffic.
Except google cloud doesn't use Nvidia GPUs but TPUs.
Google has both. Afaik we don't know whether OpenAI models will run on TPUs or GPUs here.
1 reply →
First answer this: How are they trusting OpenRouter not to distill them?
Open router doesn't host the models, so they wouldn't have access to the weights or reasoning traces right?
They can still collect (input,output) pairs.
America is a high-trust society.
Japan is a high-trust society. America is the opposite.
The US is medium trust.
Everything is relative, but fair enough.
More like - America is a high-litigation society.
I don't believe threat of litigation alone explains the extent of it.
The way an American company, esp a reputable one like Google, conducts itself internally is different. There will be much more internal backlash to do the wrong thing way before litigation.
Contracts and lawyers are more powerful than any technical tool.
Yeah like the copyright lawyers of content owners that got their works trained on?
How many trillions of dollars were those content owners worth?
2 replies →
Google Cloud couldn't give a shit about Google Deepmind, and backdooring Clouds customers only stands to hurt Cloud.