I can't tell, do you think Karpathy is actually making progress, or is he spinning wheels into arbitrary dimensions that have no fundamental connection to progress in the field?
The interesting thing about the LLM is it can spit out so many near-misses that it is a powerful gambling thing; but it's only gambling if you're not winning. Just like the stockmarket can be a rational excercise in finding undervalued stocks and providing liquid knowledge by extracting the value.
So that's probably the argument ensuing: Are the majority of people using LLMs to "play the stocks" as gamblers or as rational analysts.
I can't tell, do you think Karpathy is actually making progress, or is he spinning wheels into arbitrary dimensions that have no fundamental connection to progress in the field?
The interesting thing about the LLM is it can spit out so many near-misses that it is a powerful gambling thing; but it's only gambling if you're not winning. Just like the stockmarket can be a rational excercise in finding undervalued stocks and providing liquid knowledge by extracting the value.
So that's probably the argument ensuing: Are the majority of people using LLMs to "play the stocks" as gamblers or as rational analysts.