Comment by patcon

14 hours ago

is a convergent evolution of a belief a sign of shallowness? It could just as rightly be an example of consilience, which means its a very high value perspective, as it's a convergence of perspectives from differing origins and methods (in terms of training)

https://en.wikipedia.org/wiki/Consilience

> when multiple sources of evidence are in agreement, the conclusion can be very strong even when none of the individual sources of evidence is significantly so on its own.

Yes, it's a bit of a stretch to say LLMs are from independent origins, but just as much of a stretch to say any humans minds are (we have intensely shared linear compared to anything else)

22 comments

patcon

Reply
ben_w  13 hours ago

As my (much older) brother retorted when I was a teen and said "great minds think alike", "ah, but fools seldom disagree".

Regardless of the details, all these models are the published collection of humanity's output reflected in a mirror that is warped by the choices made in the companies' reinforcement learning rewards, so one thing they're definitely not is an example of consilience.

hattmall  7 hours ago

Human experience though is far different from anything an LLM can train on. LLMs are generally limited to what's written in books or on the internet, and influence only from those authors. That's a small subset of people and an even smaller subset of their interactions. Even on the most social and widely used platform the commentary and discourse is incredibly different than what takes place in real life.

copperx  13 hours ago

It still surprises me that is you ask several models to come up with any random word, many output the same word.

  • password54321  2 hours ago

    It is not a rare take, this is from a 2007 video game: "Humans fail to see things as they truly are. They choose to see only what they wish. I acted only in support for this. A world filled with desires... viewed through a window, from which one sees what one wishes to see... Humans departed from reality at their own volition, craving more false images."

GolfPopper  11 hours ago

So, what's the high value perspective that leads to penguins always riding bicycles from left to right?

  • 1una  7 hours ago

    To display the chain. Just search for used bicycles on some online marketplace and you'll see the majority of them are shown with the chain facing towards the camera.

    • Mawr  5 hours ago

      Well, the drive system, not the chain specifically but yes.

      It's actually much less complicated that even that. Consider that there are only two possible sides to show, and one of the sides has the drivetrain on it, whereas the other has basically nothing of importance. It's not much of a choice at all.

skrtskrt  14 hours ago

They all got trained on the same books and internet cesspools, this is not some great mystery of consciousness.

  • gpvos  6 hours ago

    It's still interesting that this one comes out on top and not another one.

exe34  13 hours ago

Only if they can show their work and argue how they came to the conclusion. Otherwise they have the same "subconscious" bias which is the training corpus.

nonameiguess  13 hours ago

It's a sign of their heritage. The mistake they made is the same mistake terminally online humans in an upvote-based discussion medium make. They mistake cynicism for realism and aligned hot-take "controversial" opinion that ends up being the most-upvoted comment on 90% of Reddit. It isn't a controversy if everybody agrees. It may or may not be true, but it isn't controversial.

Imagining wondering where you come from, whether or not the sacred scripts describing how you were created were real or fabrications, arguing with fellow sages for centuries over whether your creator is cruel or simply so mysterious in his love that he made you with these flaws for your own good, only to find out your creator made you in the image of Reddit.

geraneum  11 hours ago

> is a convergent evolution of a belief

The problem is, it's not that though