Comment by TeeWEE
2 years ago
Lossy compression of all world information results in super intelligence....
Thats the whole eureka thing to understand... To compress well, you need to understand. To predict the next word, you need to undestand the world.
Ilya explains it here: https://youtu.be/GI4Tpi48DlA?t=1053
Also to support this: Biological systems are often very simple systems but repeated a lot... The brain is a lot of neurons... Apparently having a neural net (even small) predicts the future better... And that increased survival..
To survive is to predict the future better than the other animal. Survival of the fittest.