Comment by ako
14 hours ago
> This year honestly feels quite stagnant. LLMs are literally technology that can only reproduce the past.
Is this such a big limitation? Most jobs are basically people trained on past knowledge applying it today. No need to generate new knowledge.
And a lot of new knowledge is just combining 2 things from the past in a new way.
Most people are capable of long-term learning. Some people are capable of discovering and inventing new things. I think the two are related, and current NN architecture doesn’t allow this. An AI that can cobble together a CRUD application to spec is one thing. An AI that can come up with a new idea for a successful app on its own is a completely different ball game.