← Back to context

Comment by overgard

10 days ago

Well, when the leaders of this movement go around doom-trolling for years on end this is what happens. It turns out you need to be careful what you say if you're a highly visible public figure. Amazing!

Honestly, with open source models I don't think this regulation means anything because there's no way they can really regulate what's coming out of china. I don't think this affects innovation in AI much at all (unless your definition of innovation is "pour more money into diminishing scaling"). It's mostly just bad news for the US frontier labs, and based on their behavior I don't feel sad for them AT ALL. Like, they've basically alienated the vast majority of people by outright threatening their livelihoods or even society at large, and now we're supposed to feel sorry for them because they can't just go around saying "THIS WILL REPLACE ALL JOBS IN A MONTH!" without consequences?

> because there's no way they can really regulate what's coming out of china

Do you think the Chinese will go parading around that they've created the greatest cyberweapon known to man, and the CCP will be totally cool with the Americans being first in line to buy tokens, because hey, free market?

They would sooner put all their own employees in an incinerator than allow that to happen.

the truth is that doom is a high likelihood

sorry we don't lie about that

  • If they actually think that, then.. stop working on AI? Being the first person to end the world doesn't exactly gain you anything. I guess there's a bleak humor to Altman and Musk and Amodei being forced to live out the rest of their days in their bunkers I guess.

    Like seriously, to the people that think this is a doomsday thing, if you're serious about that line of thought then STOP DOING IT. It's like the people that are arguing that AI is conscious. IF you truly believe that, then we've just reinvented slavery, and again, STOP!

    I 100% do not accept the "it's inevitable anyway so morality is out the window". We also have nuclear weapons but we don't need to rush into World War 3. Also nothing inevitable requires trillions of dollars a year to advance because it's so deeply unprofitable.

    • Its a existential cold war now between the US and China.

      There is no standing down until one side wins. Both countries would leverage (or hope to) an ASI to destabilize the other.

It’s likely that this would slow down the rate of advancement at the Chinese labs as well

  • Or significantly increase their market share outside the US and give them some breathing space to catch up with the currently available closed models

  • I don't see how, other than that it will make it harder for chinese labs to train their models on OpenAI/Anthropics' (which honestly I can't get that worked up about plagiarism in this space considering where they got their data from..)