Comment by sailfast
1 day ago
This is a really interesting article! While I can’t profess to understand all the math it is a great way to demonstrate it.
I recall awhile back hearing someone ask whether intelligence was actually the same or similar to “compression” or storing all of this knowledge in weights - IE the ability to create something from reason or weights or relationships / connections. This article makes it even more interesting!
For anyone interested, here is a recent 3Blue1Brown series on "Compression is Intelligence": https://www.youtube.com/watch?v=l6DKRf-fAAM
(For anyone not familiar with 3B1B, it's a YouTube channel that visualizes intriguing math concepts to explain them intuitively!)