Ask HN: Why doesn't AI use dynamical neurons instead of static activations?
3 hours ago
Why doesn’t AI use dynamical neurons instead of static activations even when it is known that biological neurons are dynamical systems?
3 hours ago
Why doesn’t AI use dynamical neurons instead of static activations even when it is known that biological neurons are dynamical systems?
Dynamical neurons are not used because they add enormous computational cost and instability for limited practical gain.
What do you mean by "they add instability"?
I guess it's impossible to simulate billions of dynamical neurons with current computer architecture, it is limited by memory bandwidth.
I agree, but maybe there is no need for billions of neurons to be simulated right away. Artificial neural networks were pretty small at the time.
and they did not do much
1 reply →