Comment by onlyrealcuzzo
19 days ago
Obsolete by?
This seems like a broken clock having a good chance of being right.
There's so much progress, it wouldn't be that surprising if something quite different completely overtakes the current trend within 5 years.
> Obsolete by
By NN models overcoming the pivot over representing language - according to LeCun in the article. It could be the Joint Embedding Predictive Architecture - we will see.
> There's so much progress, it wouldn't be that surprising
LeCun's point looks like a denunciation over an excessive focus over the LLM idea ("it works, so let's expand that" vs "it probably will not achieve the level of a satisfactory general model, so let us directly try to go beyond it").
Obsolete by price. This technology only scales linearly. All the investment in it had a different growth expectation. I suspect this level of investment will eventually collapse.