Comment by j_maffe
14 days ago
> But ... that's not how science works
Not sure where this is coming from.
Also, it's important to keep in mind the quote "The electric light did not come from the continuous improvement of candles"
14 days ago
> But ... that's not how science works
Not sure where this is coming from.
Also, it's important to keep in mind the quote "The electric light did not come from the continuous improvement of candles"
Well, having candles and kerosene lamps to work late definitely didn't hurt.
But in any case, while these things don't work in a predictable way, the engineering work on lightbulbs in your example led to theoretical advances in our understanding of materials science, vacuum technology, and of course electrical systems.
I'm not arguing that LLMs on their own will certainly lead directly to AGI without any additional insights, but I do think that there's a significant chance that advances in LLMs might lead engineers and researchers to inspiration that will help them make those further insights. I think that it's silly that he seems to be telling people that there's "nothing to see here" and no benefit in being close to the action.
I don't think anyone ould disagree with what you're saying here, especially LeCun.