Can you explain it without reaching for lofty things like consciousness? To me stochastic parrots is literally how it works given that it’s “just” the most impressive data fit we’ve ever done. Apparently generating mathematics reasoning traces + verifying them with lean works super well.
The network goes through 100 plus layers which end up doing all sorts of processing in ways we don't quite understand because it gets there through gradient descent but is probably similar to how human brains do it.
I daresay parrots can be quite smart too but I don't think that's what the critics were referring to.
It is more of the usual though isn't it? OpenAI cribbing off of mathematicians that have used their services; deciding to put a lot of compute behind fruitful areas of endevour; getting results, then taking credit.
Can you explain it without reaching for lofty things like consciousness? To me stochastic parrots is literally how it works given that it’s “just” the most impressive data fit we’ve ever done. Apparently generating mathematics reasoning traces + verifying them with lean works super well.
The network goes through 100 plus layers which end up doing all sorts of processing in ways we don't quite understand because it gets there through gradient descent but is probably similar to how human brains do it.
I daresay parrots can be quite smart too but I don't think that's what the critics were referring to.
no ur right it's actually god
It is more of the usual though isn't it? OpenAI cribbing off of mathematicians that have used their services; deciding to put a lot of compute behind fruitful areas of endevour; getting results, then taking credit.
no, they did not steal the notes of 100s of people working on these 100s of problems, be serious
It’s wonderful.