Comment by _heimdall
1 month ago
That's part of the problem though, isn't it? We still don't really understand how human intelligence works. We don't know how we learn. We don't even know where or how memories are stored.
We have ideas about how it works, sure. We know a bit about how the basics of the brain works and we know some correlations of what areas of the brain electrically light up in various conditions, but that's about the extent of it.
Its hard to really create an artificial version of something without pretty well understanding the real thing. In the meantime, brute forcing it is probably the best (and most common) approach.
Is it really the best approach though if we sink all this capital into it if it can never achieve AGI? It’s wildly expensive and if it doesn’t achieve all the lofty promises, it will be a large waste of resources IMO. I do think LLMs have use cases, but when I look at the current AI hype, the spend doesn’t match up with the returns. I think AI could achieve this, but not with a brute force like approach.
There's still even a more fundamental question before getting there, how are we defining AGI?
OpenAI defines it based on the economic value of output relative to humans. Historically it had a much less financially arrived definition and general expectation.
You really can't take anything OpenAI says about this kind of thing seriously at this point. It's all self-serving.
1 reply →
Market will sort that out just like it did dotcom or tulip madness.
Another big push back is copyrighted content. Without proper revenue model how to pay for that?
That will also restrict what can be "learned". Already there's lawsuit, allegations of using pirated books etc
I'll be surprised if anything meaningful comes of those issues in the end.
Copyright issues here feel very similar to claims against Microsoft in the 80s and 90s.
Yes for sure AI or even basic computing prior to that has done wonders, chess being one example. Simply removing some of the issues with humans - inconsistency, errors due to mood or form etc.
I agree this approach is only viable one but I do hope the other way is also being tried. Who knows there may be a breakthrough. Like they try to create life from basic chemicals present in nature.