Comment by namjh

...And the all the internet built was notoriously tokenized and fed into the pretraining pipeline to <insert company name here>.