Comment by nanomonkey
2 years ago
If that is the case, why don't AI models have built in feedback loops, where the humans that use them can continuously work with the model and provide further human data. The edge models can then merge in their modifications to a public model, or be island and refined based upon the human's needs.
Because they need vast amounts of data. Humans can only type so quick. Current AI models are trained on, essentially, the totality of publicly available human writing output across the past few decades. That's a lot of text.
Understood, I'm not suggesting that your feedback would make an appreciable change to the model, but provide "human" data for refinement. Continuous feedback from each user would supply more data than having a static model.