← Back to context

Comment by usef-

2 days ago

I said this in the other thread, but they were proven right about their gpt2 worries, weren't they?

From the original 2019 release:

> We can also imagine the application of these models for malicious purposes , including the following (or other applications we can’t yet anticipate):

    Generate misleading news articles
    Impersonate others online
    Automate the production of abusive or faked content to post on social media
    Automate the production of spam/phishing content

> These findings, combined with earlier results on synthetic imagery, audio, and video, imply that technologies are reducing the cost of generating fake content and waging disinformation campaigns. The public at large will need to become more skeptical of text they find online, just as the “deep fakes (opens in a new window)” phenomenon calls for more skepticism about images.

These worries are why they stated they were cautious in rolling it out

https://openai.com/index/better-language-models/

> The public at large will need to

Ah, yes. You see, it’s not them who are wrong for knowingly releasing something they knew to be harmful, it’s everyone else who needs to change. That seems reasonable. Humanity is famous for being able to rapidly adapt to fast changes as one voice. Oh, wait…

They are no different to the tobacco and oil companies. They know the harm they’re causing but care about personal profit about everything else.

  • I'm not an AI booster, but in this case I'd say that pausing the rollout for mitigations (such as public education) to be put in place was the responsible course of action.

    With the benefit of hindsight, you can certainly argue that the pause wasn't long enough or that the mitigations weren't sufficient. But that wasn't a view held by many at the time - indeed, it was mocked as a marketing ploy (and still is; see gp's post as evidence).

    • > pausing the rollout for mitigations

      What mitigations? Nothing they’ve done is relevant to the four points in the comment above.

      > such as public education

      Their “public education” is about as meaningful as alcohol warnings.

      https://www.youtube.com/watch?v=Xj4aRhHJOWU

      > With the benefit of hindsight

      No hindsight needed. These problems were obvious from the start. Not just to me but to many others. Clearly also to them.

      > indeed, it was mocked as a marketing ploy (and still is; see gp's post as evidence)

      Two things can be true at once. Of course it’s marketing to say “this is too dangerous to release” if they’re going to do it anyway. Either that or they’re so supremely irresponsible and greedy that they don’t care about the consequences as long as they can profit. And again, all of those can be true at once.

      Also, worth noting that when they talk about it being “too dangerous”, they’re usually talking about fantasy scenarios of the AI gaining sentience and enslaving humanity. But there are many other dangers (as listed in the comment above) to consider that come from humans directly misusing the technology.

      1 reply →

  • Yes, it's not their fault, that people are using the tool they made in a malicious way.

    I hate ClosedAI as much as the next guy, but this is an extremely illiberal take. It's not the kitchen knife manufacturer's fault that people are using their product for murder, it's not my fault that people are doing crimes over the Tor relay I run.

    The Tobacco industry is evil because it misleads the public about its product being poisonous and bribes politicians through widespread corruption. Tobacco is also different because it is not a neutral tool that can be used for good and bad, but poisonous and will harm you no matter how you use it.

    • > Yes, it's not their fault, that people are using the tool they made in a malicious way.

      Yeah! It’s not like they predicted these malicious uses before releasing the tools. And it’s not like they’re making them available to a dysfunctional government in order for them to militarise the technology and… Oh, wait…

      > but this is an extremely illiberal take.

      I’d appreciate if we stopped this Americanised version of poisonous discourse where everything is reduced to a box in a vague political ideology. By this I don’t mean politics don’t matter—they do—but not everything is black and white, right and left, or needs to be categorised to be discussed.

      > It's not the kitchen knife manufacturer's fault that people are using their product for murder, it's not my fault that people are doing crimes over the Tor relay I run.

      Always with the kitchen knife. That’s not an argument, it’s a talking point. Explosives are tools too, as are machine guns. No tool is entirely neutral. LLMs are not comparable to kitchen knives. Death is not the only possible bad outcome.

      > Tobacco is also different because it is not a neutral tool that can be used for good and bad, but poisonous and will harm you no matter how you use it.

      Tobacco is not just cigarettes.

      https://leafngrainsociety.com/featured/10-surprising-uses-of...