Comment by TedDoesntTalk
4 days ago
> a finite number of neurons in a finite number of configurations
Neurons and synapses change, especially synapses (the connections between neurons). Some neurons have a few connections to other neurons. Others have hundreds of thousands of connections to other neurons. These grow and change. "Estimates are between 100 trillion and 1,000 trillion neural connections" Is it finite? Depends on your definition of finite. If anything countable is finite, then it is finite but the number may be practically uncountable. Is it fixed? No.
That's 100G to 1T. Neurons are more complicated than weights, so add a x1000 somewhere, but they have more redundancy because they are noisy, unrelilable and may even die, so divide by some small number.