← Back to context

Comment by zinodaur

6 days ago

> AI doesn't exist. It is a marketing term used by grifters to sell their snake oil.

They've claimed the term, this is not a useful objection to make at this point. And everyone was fine with calling our shitty little computer vision handwriting parsers "AI algorithms" before LLMs.

> We've somehow been able to do this for nuclear weapons which can literally obliterate civilization at the press of a button

Knowing what you know about nuclear weapons, if you ran into the Manhattan Project scientists, would you still be cheering them on? "Thanks guys, our democracies are so stable these will literally never be used for a nuclear holocaust, and they might have useful mining applications!"

Can you not think of any exceptionally nasty things the US government could do with the "machines that act as if they can think for most practical purposes"? Do you think maybe it might be a good idea to develop that technology after you have made sure that the government serves the peoples interest?

> They've claimed the term, this is not a useful objection to make at this point.

Sure it is. Someone saying that the sky is purple will never be true, no matter how many times they say it. Pushing against this is how we avoid the fabricated mystique around this tech, precisely so that people don't see it as a threat.

> Knowing what you know about nuclear weapons, if you ran into the Manhattan Project scientists, would you still be cheering them on?

You're twisting my words. I never said that I support what "AI" companies are doing. I said that your claim that "AI is killing people" is hyperbolic, and that you're barking up the wrong tree.

Besides, the scientific research invested in nuclear technology has produced far more benefits for humanity than drawbacks. It's very likely that the conversation we're having now wouldn't have been possible without this research. There's an argument to be made that even nuclear weapons and their deployment in WW2 had a more positive outcome than any alternative would've had.

Similarly, the same can be said about the current generation of "AI". For all its potential dangers and harms, whether direct or indirect, it has and will continue to have many positive use cases, some of which we haven't discovered yet. Ignoring this and opposing the tech altogether is throwing out the baby with the bathwater.

The solution isn't banning the tech. It's strongly regulating it, as we've done with many others. Unfortunately, governments move at glacial speeds, and some are deeply entrenched with corporations, so there's conflicts of interest galore, but that's still the most sensible approach to manage it safely.

> Can you not think of any exceptionally nasty things the US government could do with the "machines that act as if they can think for most practical purposes"?

Sure I can. Any government, organization, or individual can abuse any technology. But you haven't made the case why opposing technology itself would prevent that, versus holding those individuals accountable directly. Until then your comments come across as misplaced fear mongering.

> Do you think maybe it might be a good idea to develop that technology after you have made sure that the government serves the peoples interest?

So what do you suggest? We stop all tech R&D because governments can't be trusted? That's pure fantasy. No single government would even agree to it since technology is universal. If the US doesn't invent it, another country will. Advancing within this messy geopolitical framework is the only path forward, for better or worse.

  • > Any government, organization, or individual can abuse any technology. But you haven't made the case why opposing technology itself would prevent that, versus holding those individuals accountable directly

    I think we should hold the individuals accountable directly. But we can't. The system is skewing further and further from the point where we could. Look at the Epstein files - everyone on the planet knows that there is a mountain of evidence condemning someone rich and powerful, and nothing will be done about it.

    In the meantime, I want to stop handing weapons to the powerful people that we can't hold to account. I don't think we should stop all R&D - but I think "machines that act as if they can think for most practical purposes" are uniquely dangerous. I also used to think the "AI" companies were full of shit, until my work handed me a bottomless anthropic API key to use for claude code. They can successfully navigate novel situations using tools to interact with the world. Tasks like "find me 20 puritanical whitehouse staffers who are cheating on their spouses, using credit card / location history" are now costly only in terms of api tokens. Going the other direction - "Find the organizers of this protest. Using all the information collected by big tech, find an unrelated criminal offence they have committed".