Comment by cududa
13 days ago
That is, fundamentally the marketing ploy of “AI Safety”.
For an AI system to be “completely safe”, like a self-driving car, it must map the full environment it operates in and be taught the “right way” to handle every conceivable scenario.
So when you present it with novel data or a situation, that constitutes an “AI safety event”, which per their ToS is a carve out for training on your session.
Further, go read the ToS carefully about what you opt out of. You’ll note there’s nary a mention of tool calls. You’re only opting out inputs (what you type) and outputs from the model from being trained on. All the content of the tool calls made while running on your system are fair game for training.
There is no way this is true, no? This'd mean literally all codebases people are working with have been trained on. There's no way anyone would use these guys if that was the case?
Why are you using it if you don’t want it to get better whose data is it supposed to get better on just somebody elses, not yours?
They're supposed to be focused on genuine training improvements over existing data, including via RL. Gathering data under the table is misaligned behavior.
2 replies →
[dead]
Well for us Europeans, GDPR explicitly allows them to store pretty much anything if somebody can claim it’s for safety.
It’s literally just complicating things and providing zero reassurance to us AI customers.
For safety - hmm new for me (European), please elaborate.
You don’t need user consent to retain data that’s arguably needed to provide the service itself. I guess, safety falls into that category. Training on that data is probably a grey area, if they can guarantee it won’t contain PII. They have stolen all the internet, so I wouldn’t bet highly on their restraint.
1 reply →
For safety = for the Stasi equivalent that can request it without a warrant, unlike von der Leyen's phone. Until it gets leaked to criminals through North Korean state actors.
They're data brokers so it was kind of expected.
It doesn't say for whose safety. It's certainly not yours.
[dead]
Additionally, how stable are those ToS? Do they change every few days, like their models?
They stay pretty stable, but you also essentially agree to the content of the model specs and previous versions, which is thousands of pages you’re in essence agreeing to.