Comment by array_key_first
4 days ago
Yes, but the inference cost of humans is extremely low. We're constantly making decisions and generating thoughts, most subconscious, while using extremely little energy. It's remarkable how energy efficient the human body and mind, and animals in general, are.
Yes it is impressive but the front loading shouldn't be dismissed
But LLMs don’t get a pass on the billions of years of front loading either. I mean, I see what you’re saying, and I get your point for sure, but my point is that we should be able to find a more clever way to accomplish this that builds off our billions of years of front loading. LLMs seem like the lazy way out in a way.