Comment by discreteevent
3 months ago
> The hard part is discrimination: whether a given mental jump is "creative" or "insane"
That's what they mean by LLM's can't jump. They mean it can't make a creative jump. Their example is Einstein's Theory of Relativity - It's not a random jump.
Einstein didn't magically one day woke up and jump on relativity theory. He had prerequisites in terms of recent mathematical advancements (notation) and physical discoveries, and a job exposing him to a lot of lateral thinking, and time to bounce ideas around in his head. We don't know how many fruitless jumps he made before making one that we remember him for.
No one’s saying that relativity appeared out of thin air, but Einstein still made a conceptual leap that LLMs are incapable of replicating.