Comment by patcon
12 hours ago
is a convergent evolution of a belief a sign of shallowness? It could just as rightly be an example of consilience, which means its a very high value perspective, as it's a convergence of perspectives from differing origins and methods (in terms of training)
https://en.wikipedia.org/wiki/Consilience
> when multiple sources of evidence are in agreement, the conclusion can be very strong even when none of the individual sources of evidence is significantly so on its own.
Yes, it's a bit of a stretch to say LLMs are from independent origins, but just as much of a stretch to say any humans minds are (we have intensely shared linear compared to anything else)
As my (much older) brother retorted when I was a teen and said "great minds think alike", "ah, but fools seldom disagree".
Regardless of the details, all these models are the published collection of humanity's output reflected in a mirror that is warped by the choices made in the companies' reinforcement learning rewards, so one thing they're definitely not is an example of consilience.
Human experience though is far different from anything an LLM can train on. LLMs are generally limited to what's written in books or on the internet, and influence only from those authors. That's a small subset of people and an even smaller subset of their interactions. Even on the most social and widely used platform the commentary and discourse is incredibly different than what takes place in real life.
Sure but concepts that resonate with actual human experience get repeated/amplified. Manuscripts don't burn and all that.
You can spend all your life reading about love but will never know what it is until you experience it.
2 replies →
It still surprises me that is you ask several models to come up with any random word, many output the same word.
So, what's the high value perspective that leads to penguins always riding bicycles from left to right?
To display the chain. Just search for used bicycles on some online marketplace and you'll see the majority of them are shown with the chain facing towards the camera.
Well, the drive system, not the chain specifically but yes.
It's actually much less complicated that even that. Consider that there are only two possible sides to show, and one of the sides has the drivetrain on it, whereas the other has basically nothing of importance. It's not much of a choice at all.
They all got trained on the same books and internet cesspools, this is not some great mystery of consciousness.
It's still interesting that this one comes out on top and not another one.
Only if they can show their work and argue how they came to the conclusion. Otherwise they have the same "subconscious" bias which is the training corpus.
It's a sign of their heritage. The mistake they made is the same mistake terminally online humans in an upvote-based discussion medium make. They mistake cynicism for realism and aligned hot-take "controversial" opinion that ends up being the most-upvoted comment on 90% of Reddit. It isn't a controversy if everybody agrees. It may or may not be true, but it isn't controversial.
Imagining wondering where you come from, whether or not the sacred scripts describing how you were created were real or fabrications, arguing with fellow sages for centuries over whether your creator is cruel or simply so mysterious in his love that he made you with these flaws for your own good, only to find out your creator made you in the image of Reddit.
> is a convergent evolution of a belief
The problem is, it's not that though
could this be... an actual example of "begging the question"?!
could this be an example of... No, I need to breathe. This website takes personal attacks personally. I'll just throw a question at you instead. Is all social media being shaped like facebook convergent evolution or a deliberate tactic to make everyone stupid and amnesiac so that they don't remember what happened one year ago?
Yup, you put it better.
https://xkcd.com/2039