Comment by yubblegum
3 days ago
Isn't it amazing that all our jobs are being gutted or retooled for relying on this tech and it has this level of unreliability. To date, with every LLM, if I actually know the domain in depth, the interactions are always with me pushing back with facts at hand and the LLM doing the "You are right! Thanks for correcting me!"
> Isn't it amazing that all our jobs are being gutted or retooled for relying on this tech
No not really, if you examine what it's replacing. Humans have a lot of flaws too and often make the same mistakes repeatedly. And compared to a machine they're incredibly expensive and slow.
Part of it may be that with LLMs you get the mistake back in an instant, where with the human it might take a week. So ironically the efficiency of the LLM makes it look worse because you see more mistakes.
Sorry, your comparative analysis (beyond its rather strange disconnect with your fellow Human beings) ignores the fact that a "stellar" model will fail in this way whereas with us humans, we do get generationally exceptional specimens that push the envelope for the rest of us.
To make this crystal clear: Human geniuses were flawed beings but generally you would expect highly reliable utility from their minds. Einstein would not unexpetedly let you down when discussing physics. Gauss would kick ass reliably in terms of mathematics. etc. etc. (This analysis is still useful when we lower the expectations to graduated levels, from genius to brilliant to highly capable to the lower performance tiers, so we can apply it to society as a whole.)
> your comparative analysis (beyond its rather strange disconnect with your fellow Human beings)
You seem to be having a different conversataion here. I'm comparing work output by two sources and saying this is why people are choosing to use on over the other for day to day tasks. I'm not waxing poetic about the greater impact to society at large when a new productivity source is introduced.
> ignores the fact that a "stellar" model will fail in this way whereas with us humans, we do get generationally exceptional specimens that push the envelope for the rest of us.
Sure, but you're ignoring the fact most work does not require a "generationally exceptional specimen". Most of us are not Einstein.
2 replies →