Comment by fc417fc802
3 hours ago
Well, pirated. Piracy and stealing aren't the same thing.
Regardless, I acknowledged the general issue. However I pointed out that doing so was not a technical necessity. If you base your worldview or actions around X implying Y but then it turns out that actually Y was merely a matter of convenience you're probably going to arrive at a wrong conclusion.
There's also the issue where you're emphatically calling it stealing without providing a clear criteria. The legal system as a whole has yet to conclusively resolve the various piracy accusations. The legality of consuming publicly available content remains quite controversial.
It absolutely is a technical necessity. You could build a model from scratch today without doing the same thing. And every model attempting to train on AI generated output degrades into nonsense almost immediately.
There’s a reason Reddit is making millions of dollars letting these companies mine their human generated content. You think OpenAI or anyone else would pay for that if they could just cyclically train on AI generated content???
> attempting to train on AI generated output
I said nothing about that. Good synthetic data does not (typically) involve ML algorithms. Although that might be changing.
I'll politely suggest that you go read the literature before engaging further.
Reddit, Twitter, and similar are valuable because the data covers current events. Their content makes up a reasonably comprehensive timeline of the world at large. You don't need that to train a barebones functional model but it's certainly useful in order to train a knowledgeable one. Regardless, if they're charging for access it clearly isn't piracy so it doesn't seem like your original objection would hold any water in that case.
> I'll politely suggest that you go read the literature before engaging further.
Which commercial AI vendor has not stolen any content when creating their models? I’ll wait.
Which commercial AI vendor has created their models exclusively training on datasets created and created by other AI?
> Regardless, if they're charging for access it clearly isn't piracy so it doesn't seem like your original objection would hold any water in that case.
Given that they were previously violating the site’s terms of service when scraping the content: yes, they were absolutely stealing.