Comment by mrandish
5 hours ago
> So would you say that those devices can confirm the ground truth about physical reality
Within the limits of resolution, range, location and veracity of sensors, a machine can register their reported state and use it as a variable. That's substantially different than the level of knowledge and understanding implied when we say a human "confirms ground truth about physical reality." The first ~half of the difference is humans have a deep world model about the planet which surrounds any sensor and human sensations are pre-processed and filtered by a highly evolved bio-chemical substrate before ever reaching the higher-order cognitive processes which assign words, meaning and qualia to them.
> therefore are capable of creativity?
I never mentioned creativity, nor would I in relation to LLMs. Like "Intelligence", "Creativity" is far too vague to be of any use in assessing the capabilities, limitations or utility of LLMs.
On HN, posts like the OP tend to attract POVs at polar extremes from "LLMs are nothing more than stochastic parrots" to "LLMs are (or can be) as intelligent, creative, innovative (etc) as any human or all humans combined." I've researched and thought a lot about these and related topics for a very long time, Neither POV is going to find any quick agreement or easy answers from me.
There's a tiny germ of truth somewhere in both extremes that's drowning in an ocean of confusion ranging from "definitionally or categorically muddled" to "mostly incorrect" to "not even wrong". But neither POV seems interested in anything more than drive-by hot takes, debating over-simplistic strawmen or trading 'gotcha' hypotheticals.
> The first ~half of the difference is humans have a deep world model about the planet which surrounds any sensor and human sensations are pre-processed and filtered by a highly evolved bio-chemical substrate before ever reaching the higher-order cognitive processes which assign words, meaning and qualia to them.
Great, but we also build robots with world models and sensory pre-processing. So nothing you've described is unique to humans.
> I never mentioned creativity, nor would I in relation to LLMs
The topic of this thread is whether LLMs are capable of genuinely contributing "new" ideas. So if that's not the point you're trying to make, I'm not sure of the purpose of your comment.
> But neither POV seems interested in anything more than drive-by hot takes, debating over-simplistic strawmen or trading 'gotcha' hypotheticals.
I think you've oversimplfying the discussion here.
In my view, at least, both "LLMs are nothing more than stochastic parrots" and "LLMs can be as intelligent, creative, innovative (etc) as any human or all humans combined." are simultaneously true, for the simple reason that humans are stochastic parrots. Our brains learn patterns and respond to stimuli.