Comment by DarkmSparks
5 months ago
>`It is also one of the fundamental mechanisms by which the human brain operates.
One of the fundamental mechanisms by which brains operate. The bits we share with every other animal with a brain,
good luck teaching your dog to code.
being great at fetching your newspaper in the morning doesn't mean its going to wake up and write you an accounting software package at the end of the year.
We don't even need that example. The example is in front of us. Take a smaller parameter model and ask it to do the same complex thing that a larger parameter model did. It will struggle.
Btw, I'm not saying it's just the number of parameters that matters.