Comment by swyx

The AI ouroboros - first we grab data from the Internet to train our LLMs, then our LLMs slowly become the majority of data from the Internet. "Low background noise" tokens will become a scarce commodity.

https://www.latent.space/p/nov-2023