Comment by anon291

The brain doesn't need to do back propagation. Back propagation is a simulation of gradient descent which the universe achieved naturally by its own devices. Indeed if you tie the loss function to some sort of excited energy state in such a way then leave it to be, the universe will naturally drive the system to its local minima.