← Back to context

Comment by gmueckl

8 hours ago

Here's a very strong take on the situation, more for discussion than a true representation of my own beliefs:

The ML models will be trained as long as we as the human society in charge allow them to be trained. Progress only happens if society allows it to happen. The commercial AI proponents are trying to do an end-run around societal adjustments, forcing change at a speed that is to fast for proper responses. It could be interpreted as a malicious attack. We, the people, could collectively decide to slow them down or to make them stop. Their hope is to confront us with a done deal before any opposition has found the resolve and organization to do anything meaningful about it.

We, collectively, need to decide where to draw the lines on this technology and we need to decide fast.

I don't think society has enough power to control what billionaires spend their money on. The promise of AI is such an attractive nuisance for power seekers that trying to crack down on it will just force it underground, where it will be developed with even less care and oversight than it is now.

Our institutions aren't even able to control what dirt-poor pirates do on hardware they own. How in the heck are they going to be able to control what incomprehensibly-rich people do? They can purchase political favors from whichever nations are selling them.

  • > trying to crack down on it will just force it underground, where it will be developed with even less care and oversight than it is now.

    With way less access to infrastructure, hardware, capital, people. That’s literally what we need, it should be constrained by having way less resources

    • Having fewer resources such as security engineers will not lead to better outcomes. A skeleton team with gigawatts of compute in some middle east bunker is MORE likely to unleash something poorly aligned.

      1 reply →

  • Advancing the state of the art takes so many resources that it can't happen underground, at least for now. Slap enough controls on the means and the handbrakes are on. So your doomsday scenario could be preventable. The crux is that enough people need to come out in favor to put constraints in place. It's not impossible, but public opinions form slowly.

Pretty naive take.

EU and US are slowing down while China doesn't slow down. In fact, they are pushing harder after gathering so much info from workers, and facial recognitions set in place for half a decade.

Is society in charge of them? Or is it a small collective of people?

Edit: Typo

  • Society could take control back. It's not impossible. History has examples where people took control away from small collectives, although it wasn't always strictly lawfuly or even peaceful.

    To take it to the extreme, billions of virtual dollars wouldn't offer any protection against a determined lynch mob at the front door.

    More realistically, there is a lot of power in showing up in big numbers and protesting. It is beyond me why especially US culture doesn't accept that as an option these days.

> We, collectively, need to decide where to draw the lines on this technology and we need to decide fast.

I hope you, collectively, don't start deciding what deodorants I can wear. (Like Bernie Sanders infamously brought up.) Or what toys my daughter can play with. (As Donald Trump wanted.)

  • Society abides by a lot of rules that you also learned to follow, mostly while you were raised. Why else would you even wear a deodorant?

    • I wear deodorant to get along with the humans around me. Concrete folks I can point to (even if I don't necessarily know the guy next to me on the train by name nor will see him again).

      No nebulous society involved that makes collective decisions in the abstract.

      3 replies →