← Back to context

Comment by landhar

11 hours ago

> Current models are clearly nowhere near the efficiency limit (the brain does vastly more with far less power).

I think this is disingenuous. One could say that drones are nowhere the efficiency limit either: a bee can fly for hours on the energy contained in just a few milligrams of honey, while our best battery-powered drones can't stay airborne for more than 30 minutes. But comparing energy efficiency of electric/mechanical devices to their biological counterparts is not an apples-to-apples comparison. There's a world of difference between the energy storage and delivery mechanisms.

And as many have pointed out already in the siblings, it's not just about the compute but the access to petabytes of training data.