Comment by freedomben
2 years ago
> Humans do most of their thinking non-verbally and we need to figure out how to get these models to think non-verbally too.
That's a very interesting point, both technically and philosophically.
Where Gemini is "multi-modal" from training, how close do you think that gets? Do we know enough about neurology to identical a native language in which we think? (not rhetorical questions, I'm really wondering)
Neural networks are only similar to brains on the surface. Their learning process is entirely different and their internal architecture is different as well.
We don’t use neural networks because they’re similar to brains. We use them because they are arbitrary function approximators and we have an efficient algorithm (backprop) coupled with hardware (GPUs) to optimize them quickly.