← Back to context

Comment by rkomorn

4 hours ago

> We're going to have Skynet or Star Trek

Star Trek only got a good society after an awful war, so neither of these options are good.

Star Trek only got a good society after discovering FTL and existence of all manner of alien societies. And even after that Star Treks story motivations on why we turned good sound quite implausible given what we know about human nature and history. No effing way it will ever happen even if we discover aliens. Its just a wishful fever dream.

  • I'm definitely not a Star Trek connoisseur but I thought a big part of the lore is the "never again"-ish response to the wars through WW3?

    But anyway, I share your lack of optimism.

    • Well they didn't necessarily stop waging war in Star Trek either.. They also spent most of their time trying to not get defeated by parasitic artificial intelligence.

  • It isn't even just the aliens (although my headcanon is that the human belief that they "evolved beyond their base instincts" is part a trauma response to first contact and World War 3, and part Vulcan propaganda/psyop.) Star Trek's post scarcity society depends on replicators and transporters and free energy all of which defy the laws of physics in our universe (on top of FTL.)

    We'll never have Star Trek. We'll also never have SkyNet, because SkyNet was too rational. It seems obvious that any AGI that emerges from LLMs - assuming that's possible - will not behave according to the old "cold and logical machine" template of AI common in sci-fi media. Whatever the future holds will be more stupid and ridiculous than we can imagine, because the present already is.