Comment by jonahx
2 days ago
GP is saying that "the search space" of "the natural world" is much bigger than the search space of "stuff created on purpose by humans". In both cases, there will be guesswork, but in one case less.
I think there is something to this, but am even more concerned by the pure scale. Consider 100k, 1M, and 10M LOC human legacy projects (already a big problem, usually!), and now compare to the likely outcome of 100M, 1B, 10B, etc LOC llm projects. That's where you may start to see the outcomes I reference in my OP.
> GP is saying that "the search space" of "the natural world" is much bigger than the search space of "stuff created on purpose by humans". In both cases, there will be guesswork, but in one case less.
I agree. What I am saying is, we have effective tools and processes for each of these search spaces, so code no longer being "created on purpose by humans" is not the end of the world.
> we have effective tools and processes for each of these search spaces
Do we? Science (the tool for the natural world) is limited and there's so much we don't understand.
The recent superhuman achievements by llms in math are promising, but what we've seen so far isn't enough imo to YOLO building arbitrarily large systems in code and just trust that the llms will be able to handle it. Especially when the stakes are high (human lives, etc).
> Do we? Science (the tool for the natural world) is limited and there's so much we don't understand.
Limited in what way? Its basic structure is sufficient to eventually let us discover anything there is to discover. It's a fully general problem solving framework.
1 reply →