Comment by Onavo
12 hours ago
A more interesting question is...does differential equations based models like mamba/state space models perform better on this sort of physics problem than pure transformer LLMs?
12 hours ago
A more interesting question is...does differential equations based models like mamba/state space models perform better on this sort of physics problem than pure transformer LLMs?
Is it? I can't imagine why a language model would do well on this sort of problem at all.