Comment by sheafification
13 hours ago
> do you expect this to remain true? If so, for how long?
For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback loop to stay within the category of relevant ideas. I haven’t seen anyone working on fixing that.
Regarding 1, the same is true of every other scientific field. Verifying some tidbit of knowledge for yourself as an individual isn’t optimally useful in all circumstances.
Regarding 2, if the proof isn’t understandable then it probably isn’t useful. Many people today work in the hypothetical world where the Riemann Hypothesis is true, and many work in the hypothetical world where it is false. If it takes decades to validate that some horrifically complex AI proof of either fork is true, people will probably continue working on the other fork just in case.
> For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback loop to stay within the category of relevant ideas. I haven’t seen anyone working on fixing that.
I have. DataAnnotation and these other AI-training piecework companies are pretty much the backstop now against total navel-gazing model collapse. With the Dead Internet Theory now pretty much reality, it's not like there is, or is going to be, gobs of untainted human-generated data out there ripe for the harvesting so it's going to take active human effort to keep the models grounded. That is, of course, until they start inhabiting robot bodies so they can live and move around in the real world, and thereby achieve their grounding, as in GitS or Ex Machina...