Comment by coherentpony
11 hours ago
I am somewhat cynically waiting for the AI community to rediscover the last half a century of linear algebra and optimisation techniques.
At some point someone will realise that backpropagation and adjoint solves are the same thing.
There are plenty of smart people in the "AI community" already who know it. Smugly commenting does not replace actual work. If you have real insight and can make something perform better, I guarantee you that many people will listen (I don't mean twitter influencers but the actual field). If you don't know any serious researcher in AI, I have my doubts that you have any insight to offer.
I am sure they are aware...