Comment by koe123
18 hours ago
Can you explain it without reaching for lofty things like consciousness? To me stochastic parrots is literally how it works given that it’s “just” the most impressive data fit we’ve ever done. Apparently generating mathematics reasoning traces + verifying them with lean works super well.
The network goes through 100 plus layers which end up doing all sorts of processing in ways we don't quite understand because it gets there through gradient descent but is probably similar to how human brains do it.
I daresay parrots can be quite smart too but I don't think that's what the critics were referring to.