Comment by bilbo0s

>They will probably never release the training data because that represents a large part of their competitive moat

Not that what you've written isn't the case. However, in addition to what you've written, (or probably even before what you've written), there's the fact that everything they're training on is stolen IP. Same with US LLM labs.

Let's not kid ourselve's about where the training data is coming from. They are not asking artists, writers, coders, content creators, etc etc etc for permission to use their creations.

Anthropic, Moonshot et al are doing incredible things, but we shouldn't gloss over the costs. Both present and future costs are kind of enormous.