Comment by dyauspitr
3 hours ago
Calculus might not be the best analogy for my point since it’s pretty fundamental. When I think of an expert I think of an accomplished mathematician or a chemist, someone that can build on existing knowledge to provide new breakthroughs. You can ask an LLM for a particular formulation but you cannot make wide spanning connections to come up with something novel until you have a good understanding of a given space. Not all progress is a series of iterative problems and tasks that need to be solved. In fact for a lot of breakthroughs it’s making disparate connections.
> When I think of an expert I think of an accomplished mathematician or a chemist, someone that can build on existing knowledge to provide new breakthroughs.
I think we're on the same page here. Experts have both vision and execution. Someone who has simply learned a bunch of things, or a lot about one thing, is not what we consider an expert.
> You can ask an LLM for a particular formulation but you cannot make wide spanning connections to come up with something novel until you have a good understanding of a given space.
I don't get where you are trying to go with this. Using an LLM (or Page Rank for that matter) to search for tools that have been created/discovered necessary to fulfill execution of your vision seems to have nothing to do with what you are trying to say. Nobody would ask an LLM to do what you are suggesting, if I am understanding you correctly. LLMs are most definitely not good at that. That is AGI territory.