Comment by __MatrixMan__
8 hours ago
Is that constraint fundamental to what they are? Or are they just reflecting the behavior of markets when there's low hanging fruit around?
When you look at models that were built for a specific purpose, closely intertwined with experts who care about that purpose, they absolutely propel communities to new heights. Consider the impact of alphafold, it won a Nobel prize, proteomics is forever changed.
The issue is that that's not currently the business model that's aimed at most of us. We have to have a race to the bottom first. We can have nice things later, if we're lucky, once a certain sort of investor goes broke and a different sort takes the helm. It's stupid, but its a stupidity that predates AI by a long shot.
Experts making a specialized model isn't an example of an AI contributing value to society. All the value a model can offer comes from one of exactly two places: the person building the model, or the people the model trained on.
We know that the model training on the model training on the model leads to model collapse...