Comment by backscratches
4 days ago
~25 years from conception to maturity, millions and billions of years of brute force development... There is a lot of energy involved in typing this sentence to you. I am not sure LLMs use more.
4 days ago
~25 years from conception to maturity, millions and billions of years of brute force development... There is a lot of energy involved in typing this sentence to you. I am not sure LLMs use more.
Yes, but the inference cost of humans is extremely low. We're constantly making decisions and generating thoughts, most subconscious, while using extremely little energy. It's remarkable how energy efficient the human body and mind, and animals in general, are.
Yes it is impressive but the front loading shouldn't be dismissed
But LLMs don’t get a pass on the billions of years of front loading either. I mean, I see what you’re saying, and I get your point for sure, but my point is that we should be able to find a more clever way to accomplish this that builds off our billions of years of front loading. LLMs seem like the lazy way out in a way.