Comment by foolishbard
2 years ago
There's a chance that these systems can actually out perform their training data and be better than the sum of their parts. New work out Harvard talks about this idea of "transcendence" https://arxiv.org/abs/2406.11741
While this is a new area, it would be naive to write this off as just science fiction.
It would be nice if authors wouldn't use a loaded-as-fuck word like "transcendence" for "the trained model can sometimes achieve better performance than all [chess] players in the dataset" because while certainly that's demonstrating an impressive internalization of the game, it's also something that many humans can also do. The machine, of course, can be scaled in breadth and performance, but... "transcendence"? Are they trying to be mis-interpreted?
It transcends the training data, I get the usage intended but it certainly is ripe for misinterpretation
The word for that is "generalizes" or "generalization" and it has existed for a very long time.
1 reply →
That's trivial though, conceptually. Every regression line transcends the training data. We've had that since Wisdom of Crowds.
"In chess" for AI papers == "in mice" for medical papers. Against lichess levels 1, 2, 5, which use a severely dumbed down Stockfish version.
Of course it is possible that SSI has novel, unpublished ideas.
Also it's possible that human intelligence already reached the most general degree of intelligence, since we can deal with every concept that could be generated, unless there are concepts that are uncompressible and require more memory and processing than our brains could support. In such case being "superintelligent" can be achieved by adding other computational tools. Our pocket calculators make us smarter, but there is no "higher truth" a calculator could let us reach.
Lichess 5 is better than the vast majority of chess players
I think the main point is that from a human intelligence perspective chess is easy mode. Clearly defined, etc.
Think of politics or general social interactions for actual hard mode problems.
2 replies →