Comment by germandiago
6 hours ago
Maybe I do not have a good definition for it.
But what I see again and again in LLMs is a lot of combinations of possible solutions that are somewhere around internet (bc it put that data in). Nothing disruptive, nothing thought out like an experimented human in a specific topic. Besides all the mistakes/hallucinations.
Yes, LLMs have a very aggressive regression towards the mean - that's probably an existential quality of them.
They are after all, pattern matching.
A lot of humans have difficulty with very reality that they are in fact biological machines, and most of what we do is the same thing.
The funny thing is although I think are are 'metaphysically special' in our expression, we are also 'mostly just a bag of neurons'.
It's not 'natural' for AI to be creative but if you want it to be, it's relatively easy for it to explore things if you prod it to.