Comment by skeledrew
2 months ago
Pretty sure it doesn't matter to the child whether the knife has a handle or not. They'll eventually find a way to cut themself.
2 months ago
Pretty sure it doesn't matter to the child whether the knife has a handle or not. They'll eventually find a way to cut themself.
It matters to the adult - who is also an user.
LLMs do not deliver (they miss important qualities related to intelligence); they are here now; so they must be superseded.
There is no excuse: they must be fixed urgently.
LLMs deliver pretty well on their intended functionality: they predict next tokens given a token history and patterns in their training data. If you want to describe that as fully intelligent, that's your call, but I personally wouldn't. And adding functionality that isn't directly related to improving token prediction is just bad practice in an already very complex creation. LLM tools exist for that reason: they're the handles, sheaths, sharpeners, etc for the knife. Teach those adults who're getting themselves cut to hold the knife by the handle and use the other accessories that improve user experience.
> given a token history and patterns in their training data. If you want to describe that as fully intelligent
No, I would call (an easy interpretation of) that an implementation of unintelligence. Following patterns is what an hearsay machine does.
The architecture you describe at the "token prediction" level collides with an architecture in which ideas get related with better justifications than frequent co-occurrance. Given that the outputs will be similar in form, and that "dubious guessers" are now in place, we are now bound to hurry towards the "certified guessers".
11 replies →