Comment by RivieraKid

It's because existing models are a brute-force approach to intelligence. With enough data and compute, a stochastic parrot will become very impressive.

But with robotics, there's no pre-made dataset that can be parroted. Notice that these datasets, e.g. how to fold clothes, need to be created by humans. That's as if humans needed to write algorithms like quicksort to teach LLMs how to code.