Comment by dax_
1 day ago
It's just as possible that they need to invest more and more for negligible improvements to model performance. These companies are burning through money at an astonishing rate.
And as the internet deteriorates due to AI slop, finding good training material will become increasingly difficult. It's already happening that incorrect AI generated information is being cited as source for new AI answers.
They are burning through money, but their revenue is scaling at a similar rate.
I'm sure most companies have understood the "AI outputs feeding AI's" incest issue for a while and have many methods to avoiding it. That's why so much has been put into synthetic data pipelines for years.