Comment by tsunamifury

This is the right conclusion for completely wrong reasons haha. I love hn. (aside from being entirely wrong as most models are now mixed modal so they are token prediction engines)

Each layer of attention can more through feature space “lit up weight clusters” in a way no other previous AI can. It can from that decode some rudimentary logic and world modeling and make deductions. Certainly better than any previous AI. Only a goof here would believe this wasn’t a serious advancement.

So don’t over sell it. But don’t sell it short with this “grrr in an engineer don’t threaten me with new tech” attitude.

This take is akin to teenage angsty takes and doesn’t really belong here.