Comment by theplumber
3 hours ago
I pretty sure OpenAI and Anthropic are doing the same or worse. Keep in mind that these companies are in the business of stealing IP work and reselling it to you with "safety checks" so asking if they use your usage data for training is a bit naive at best. At least the Chinese companies are more open and give back to the community compared with the "frontier" providers.
> I pretty sure OpenAI and Anthropic are doing the same or worse.
No they're not. It would end both companies if they were ever found to be doing that.
Their terms are clear - if you use the coding plans they can[0] train in return. Enterprise and API, absolutely not.
The argument here is that with the Chinese labs you have zero legal recourse.
[0] opt-in, thanks
>> No they're not. It would end both companies if they were ever found to be doing that. Their terms are clear - The argument here is that with the Chinese labs you have zero legal recourse.
Their terms are not worth shit considering they are reselling you stolen copyrighted data. Even in they terms they started clearly say they retain your data for "safety reasons" for however long they want. Perhaps you didn't watch the space with Anthropic going back and forth with ToS updates(we retain your data for 30 days...stike that and add 30 days or more or no or ..whatever) like my own alpha website.
Your argument boils down to "they've done something I find objectionable, so that means everything they say must be lies".
I'm not comfortable with how these models were trained. I have quite a bit of open source code out there, and I personally see such training as copyright and license laundering.
But that's not how the law sees it, and I grudgingly accept that, regardless of how I may feel, and I don't let my feelings on the matter make me think irrationally when it comes to whether or not these AI companies honor the terms they provide.
Sure, they might be breaking their promises, training on our data when they say they won't. But I do think they most likely aren't, and that it would be corporate suicide if they were and it ever came out.
There is an enormous difference between:
* Exploiting ambiguity around fair use at a large scale before the law catches up and then jointly lobbying with your competition to make sure your interpretation of the law becomes reality.
* Explicitly signing a contract with enterprises to respect their IP and then proceeding to break that contract with your own customers.
The former is firmly in the gray area of legality and doesn't directly hurt your own customers. The latter is both an unambiguous contract violation and a flagrant attack on your own customers' most valuable asset.
9 replies →
Anthropic paid a large settlement for the copyrighted data they pirated. So far, US courts have found that it's perfectly fine to train AIs on copyrighted data for which you have legal access.
> Even in they terms they started clearly say they retain your data for "safety reasons" for however long they want.
The discussion was about training, not data retention. Two very different concerns.
And if you're a decent sized customer, most providers have a route to not even retaining the data for safety/security reasons. The reason Anthropic had issues is because they do have a path to "no data storage" for Sonnet/Opus, but not for Fable. Which is why at work we have access to the former, but not the latter.
Whether the terms are worth shit doesn't matter. If they're training on data from paying customers who have requested otherwise and it gets out (which it would, eventually), SAP, Accenture, Deloitte and other huge companies with well-funded legal teams would nuke them from orbit. This is a different area of law from the copyright stuff, different rules/norms/expectations/consequences apply.
2 replies →
I would think they are not but Alex Karp CEO of Palantir seems to imply that they are:
https://youtu.be/0A3sGymV6kY?si=ti7uSZtYqJ3vKpGM
I found it a little shocking TBH
Alex Karp says a lot of things
Are we talking about the company sending back private information through its client to « fight » model distillation?
Yes.
Enterprise contracts are checked and agreed by lawyers. The contract states no training.
If the provider fucks up, there are actual monetary damages defined for breach of contract.
1 reply →
They could use an agent to summarise the source material, and then train models on those summaries, and claim that some sort of clean-room training has happened?
You've been to too many meetings with PMs and directors saying "An agent could very easily do this"
> if you use the coding plans they train in return.
No, you have to opt-in to that. There's a privacy toggle on account settings.
For OpenAI, you have to use the Enterprise plan at API pricing in order for them not to train on your data.
Source: https://chatgpt.com/codex/pricing/?type=team
1 reply →
I think the risk of not doing is more existential than doing so and getting caught. Wouldn’t you agree?
Edit: And the point of the poster is they have already demonstrated a track record of lying and misconduct, so how can you trust their word now? What have they done to show you they have taken responsibility for past actions and changed?
lmao, wasn't xAI caught doing this recently? moreover at least moonshot is being honest about it.
they train on your requests by paraphrasing them (which means rewriting them but keeping all the saliency) and removing their association with you
i don't know why this is so controversial, their terms are written to perfectly fit this training regime
if you are using bedrock, until very recently, they didn't see your requests and could not paraphrase. but too many people were using bedrock for too much stuff they wanted to see. so that's why the terms for bedrock changed for fable 5. this was the core of the palantir / defense dept drama with anthropic.
Anthropic constantly uses dark patterns to steal training data from customers (like the “how is claude doing” spam, data retention loosening when the safeguards false positive, etc).
How is that a dark pattern? What is the light pattern for getting feedback from users?
3 replies →
There is a world of difference between:
* A company following suit with their entire industry in choosing a very generous definition of fair use.
* A company being the first to defect and actually break their signed contracts with enormous enterprises committing to not train on those enterprises' most valuable assets.
Training on copyrighted works signs them up to be a part of a system that is at this point too big to fail and places them in good company with all of their competition. Breaking their signed agreements would open them up to very well-founded and well-funded lawsuits for contract violation and give their competition a huge boost.
All of a sudden "we actually don't break our contracts" would be a selling point. No company in their right mind is going to let what should be table stakes become a differentiator for their competition.
>> I pretty sure OpenAI and Anthropic are doing the same or worse.
So in your opinion, they are training on your data even if you toggle the "don't train on my data" checkbox off?
That's a bold assertion.
Not the guy you responded to, but I would assume ”they keep it safe” somewhere in a cold storage. Just in case they decide to train on it in a later phase.
Think of it as the Big Data hype some years ago.
I don't think they'd really be willing to risk the whole company on a small subset of prompts. It's not "keeping it safe", it's retaining proof of illegal activities.
Yes, their entire existence relies on training on copyrighted content without permission being ok.
You truly see no difference between having a perhaps-overly-generous definition of fair use and flagrantly breaking contracts that you signed with your customers?
Why wouldn't they?
Because the legal system does, in fact, have teeth. And those teeth actually deploy pretty readily. Especially when the people whose trade secrets you would be violating are gargantuan companies with enough resources that the cost of a lawsuit is a rounding error.
11 replies →
Because the value obtained from doing so is unlikely to exceed the cost of the lawsuits if they were ever caught doing so.
[dead]