Comment by capyba
11 hours ago
The processing capability of today’s CPU’s and GPU’s is insane. From handheld devices to data centers, the capability to manipulate absurd amounts of data in fractions of a second is everywhere.
It’s not the hardware, it’s the algorithms.
Maybe it is the algorithms. But just by doing a op for an 10^25 param llm is definitely not feasible on todays hardware. Emergent properties does happen at high density. Emergent properties might even look as AGI.