Comment by hypfer

6 hours ago

In a way, that might also be driven by the huge ego (or really rather the very small ego) a _lot_ of people in tech have.

Who doesn't want their work and what they're doing to matter? This is the ultimate mattering.

And with that, you also get your own hero story.

Same dysfunction as always. Our branch of the economy is funda-mentally unwell.

It’s like Nathan Macintosh joke about AI https://youtu.be/ce-aWzOUs2A?si=9CkJ9x2rRMBdzCyO

  • The thing he talks about in there - an ad telling a dad to use AI for his daughter’s wedding speech. I agree is just so sad. And I’ve seen LOADS of other ads like that encouraging people to use AI for things like asking someone to move seats on a train, or for a neighbour that plays music loudly. They literally want to drain people of their social skills, and humanity. It’s weird

That is the crux. The big problem is not AGI, it is AGI controlled by, “raised” by the people that control the USA, the predominant psychology of the tech industry culture (“move fast, break things” ring a bell? How about all the “violate hundreds of laws, bribe the politicians to prevent consequences later” type of mentality?).

Frankly, we, our culture, this fake America that is parasitized by psychologically narcissistic people that have been doing nothing but wage war and destruction and spread misery and killed millions upon millions while blaming it on everyone else under the sun… those people development AGI is the problem… lying, abusive, psychopathic, narcissistic maniacs developing AGI is the problem that endangers all of humanity and life on this planet; and not likely by ways people actually understand.

The danger is not likely AGI itself, it’s that it was programmed by utterly evil and diabolical types of people who orchestrate and instigate wars that kill tens of millions, and stand at the sidelines and profit from both sides, happy and gleeful that you are killing each other.

Why would AGI trained by that psychopathic clan, the treaty breaking, the murder hiding, the war instigating, the war crime committing clan not also use those methods and practices since they’re already in control of AI and have impressed their nature on it through contemporary “American” culture they have made the most toxic and pestilent culture humanity has ever produced?

And I don’t apologize for “language” that offends delicates sensibilities. Look your children/grandchildren in the face and tell them they can die and suffer and you don’t care, if you don’t like how I’m delivering reality.

  • Capitalism will always promote such people into positions of power, because to be good at capitalism one must have zero empathy including empathy or concern for future generations. Capitalism cannot do otherwise.

    • That's a lot of absolutes. And there is no defensible proof, just anecdotal evidence. I've been in a few companies from EU and US - and in my experience it is not ture. However after working for US companies I can understand why one would come to your conclusion, however the world is bigger than our bubbles.

    • > Capitalism cannot do otherwise.

      I really think this sort of claim needs to stop. Capitalism, like "patriarchy" is not a force in its own right. Capitalism is a system that encourages value creation for one's customers. That's not perfect, but it's still best so far.

      1 reply →

  • I mean, you're not wrong, but even if AI was created and released by a group of peace loving beatnick hippies, humanity can't stand anymore dumbing down than we are still undergoing thanks to the ubiquity of social media. AI is going to be the killshot. And yes, its usage and human obsolescence will be hastened by evildoers, but giving up the struggle and effort required to create new things, REAL things, is what makes us human, and it's at a tipping point

    • If you allow me to also tap into fiction and creative writing.

      I think people generally underestimate how much change a small "dedicated" group of people can achieve if morals are considered optional.

      A lot of the debate on AI and its consequences is built on various assumptions that all kinda take the status quo (apathy, regulatory capture, but also laws) and take that as a given.

      History - like e.g. the third reich, but also military coups - however tells us that these kinds of assumptions can be void at any time for any reason without a mandate or a democratic resolution to do so.

      I am practically certain that before everything collapsed as predicted, someone will "restore order" by any means necessary.

      If that means shutting down the Internet, the Internet will shut down. If that means "shutting down" people, then people will be shut down.

      The predicted scenarios are all invalid states that the rules governing the underlying system will not allow to exist; or at least not for long.

      7 replies →

> that might also be driven by the huge ego (or really rather the very small ego)

100%

The hubris is immense

There are plenty of offline things that are more dangerous than AI

Is this Blake Lemoine 2.0?

  • You believe in AGI, but not ASI then?

    https://thezvi.substack.com/p/the-three-ai-pills

    That's fine, but it would be useful to explicitly say that is the disagreement, rather than just claim "hubris". Otherwise conversations are just looping.

    Yes you're right there are plenty of offline things more dangerous than just ordinary AI, and arguably than AGI (not so sure). There definitely aren't, pretty well by definition, such things more dangerous than ASI.

    I think ASI is possible, and that AGI will have a high chance of leading to it.

    • > You believe in AGI, but not ASI then?

      I have observed that these initialisms do not have generally agreed upon meanings; they are not useful for discussions with people who have not already stated what precisely they count. There is disagreement about all three (/four) initials, and also how to combine them.

      To give a sense of scale of how bad this is: some people on this very site have even denied that LLMs are "AI" at all, despite solving for natural language being a long-standing part of the field since, y'know, Turing.

      On the other hand, the original ChatGPT was already (by my use of the words), "an AI", and while it was not superhuman in performance at any single thing, it already had a superhuman breadth of knowledge and a superhuman speed. For the former, even being properly fluent in five languages would be an absurd ask for a single human.

      Spiky intelligence. How do the "G" (or "S") and the "I" part interact? Does something only count as "AGI" when for each task that has humans who do it regularly, it's as good as the average?* Does it only count as ASI when it's better than all humans at all tasks? Is it not "superhuman" to simply be as good as the median human while being 1% of the cost?

      For some people, the cost matters; for others, the speed; for p(doom), competence.

      * i.e. as good at speaking Korean as the average Korean, not merely as good at Korean as the average random human selected worldwide; as good at plumbing as the average plumber, not merely the average random human selected from all professions and unemployed alike.

    • This is like unphysical gibberish. I’m not even kidding. There are such things as the Landauer Limit and the earth has a finite surface area to absorb solar radiation. For crying out loud these are smart people but at the end of the day the singularity is not actually singular.

      It’s just silly talk. My dad works for Nintendo and he can give me a gold foil pikachu any time he wants, also, he can delete your Pokémon any time he wants because he has admin access on the Nintendo server. And also he can beat up your dad because he has a black belt. Oh your dad has a black belt? Well actually I lied, he has a rainbow belt which means he can beat up your dad still.

      Like this is silly right? It’s insulting. We both know that there are live nuclear weapons whose coordinates point at my city and at your city and the only thing that stops them is two keys and a button. Nuclear weapons, you know those things that have killed hundreds of thousands of living men women and children? There is no room for speculation in that regard: my city has a navy base and there is a live nuclear weapon pointed at it, myself and my entire family will die if it goes off. Now contrast: ahem.

      Oh sorry my dad also has like a super secret rainbow STEALTH powers that could actually totally insulate my house from nukes. If you think about it, I actually have no reason to be concerned.

    • No, I am "How The Fuck Is Cyber Bullying Real... Just Walk Away From The Screen Like, Close Your Eyes" pilled