Comment by samrus

humans can operate in dynamical systems (where your actions can change the underlying system). LLMs are not trained to do that and have shown to be terrible at it