Chat-GPT becomes Sex-GPT for verified adults

3 months ago (twitter.com)

Anthropic: We are releasing reports on economic impact and evaluating model welfare just in case it experiences consciousness

OpenAI: We are... doing something else...

OK, and what's the problem with that specifically? I presume they will use more sophisticated methods for age assurance than "I'm 18".

Besides, people are using LLMs for exactly that for ages (including Claude and ChatGPT), so the only difference is that the non-NSFW behaviour will be better (less crippled).

Win/win. No? Why?

  • I assume you will need to do a Blockchain Iris scan from his other company in order to prove your Age and Identity.

    • ----TINFOIL HAT BLOCK START----

      That's the idea. For too long people have been able to free-associate and share truth online. Now they finally have a reason to end anonymity online. Due to the raw power of AI there is a very real threat these new tools provide to bad actors in the generation of misinformation and disinformation and now we need to ascertain the providence of all content created online. With "AI" being injected into every site, app, and OS we will be forced to associate real world ID's to any and all actions int he digital realm in order to "protect" the public from the wave of fabricated reality they will create.

      Of course these tools will be used by those that control the moderation systems to craft and shape global negative on a scale we have never seen before. A new kind of Dark ages are here. Not one where dusty tomes are changed to the monastery walls, no, our books write and rewrite themselves in real time as needed until every thought is controlled by the over-mind.

        And I saw one of his heads as it were wounded to death; and his deadly wound was healed: and all the world wondered after the beast.
      

      Happy Prompting.

      -----TINFOIL HAT BLOCK END-----

      1 reply →

  • I don't understand the outrage. It's quite rare to see the majority on HN advocating for more content restrictions.

    Google will happily return NSFW results, without age verification.

    Google will approve ad campaigns for adult websites.

    Amazon will happily sell you NSFW books and tools. etc.

    But OpenAI should reject prompts that result in adult content?

    • The outrage here is that they have been swearing up and down to investors that they are thiiiiiis close to creating God.

      Then they show us what they have been working on and it is…

      Robot sex chats.

      They’d like another 400 billion please. They’re doing the Lord’s work here. They need to burn the planet; the competition would do it if they didn’t! This thing could turn into the antichrist any day now.

  • I don't have issue with NSFW content per se, but this? This isn't a problem of whether NSFW content should exist. It's a much bigger issue than that.

    First, mental health issues surrounding this are far from being solved. Having a sycophantic robot faking intimacy looks manipulative, ripe for exploitation, and damaging to long term psychological well-being.

    Second, this is a service that manufactures compromising chat logs and stores them for profit. Yeah, what could possibly go wrong?

  • In general I think it's perfectly fine to have uncensored NSFW chats. The fact that all of the mainstream LLMs are way more restrictive than basic web searches we've had for decades is kind of ridiculous.

    In this particular case though I can't imagine it's a good idea to hand Sam Altman and his company chat logs of your explicit fantasies tied to your real identity.

    • Those chat logs will become the most valuable data in the world. That or sex chats will become totally shameless and normalized.

  • Are you responding to something specific you're seeing in this thread or on Twitter (I can't see the replies on Twitter)?

  • I assume that the porn industry will not agree to consider the training material as fair use. And this industry has quite a lot of money for good lawyers. In this respect, we will see on what basis the quality improvement in the relevant content is to be achieved.

  • >> I presume they will use more sophisticated methods for age assurance than "I'm 18".

    Why presume that? "Are you over 18?" is the age verification method used by 99% of the web.

    • OAI is a big fat lawsuit target, plus they can restrict it and still make the money because odds are they'll also have it on API, and someone could verify for the API then offer a wrapper around OAI with less stringent ID verification.

      OAI ultimately still makes a ton of money, and gets to wash their hands of much of the liability. It's a win-win.

It's crazy that Visa, Mastercard & other payment processors were debanking actual creators and artists for adult content recently and now OpenAI is doing this.

You have to pay some respect to sama. Imagine this move done by Google, Meta, Amazon or Microsoft: It won't happen.

I've thought that the Sora videosharing app was dumb, but if it were NSFW at least it would be very popular.

Well, here we go.

I think they want to finally give their investors something stable in return and see how it works at OnlyFans.

Onlyfans models already paying poverty wages for people to pretend to be them in chat.

Presumably this will just be part of that offering.

  • Just wait until the Onlyfans models end in poverty themselves because Sora replaces them (after training on their data).

"Now that we have been able to mitigate the serious mental health issues and have new tools"

Huh? Quite the statement when there are still people out there having parasocial relationships with chatbots. This problem is going to get exponentially worse when the chatbots can start to get sexual.

Cool, I've always wanted to share my intimate desires with creepy tech bros

  • Always a new account with some snarky neo-luddite reply, as if Google, or Facebook, or Microsoft, or Amazon, doesn't already know everything there is to know about you. I mean, come on. That ship has sailed at least two decades ago and this kind of conversation simply isn't productive imo.

    • This is a ridiculous attitude, exactly equivalent to 'if you've nothing to fear you've nothing to hide'. In practice different geographic localities (e.g.: EU, California) have far different (and improving) limits on the personal information that can be stored by companies and how it is used.

      Various forms of online hygiene, from ad blocking to VPNs, to anonymous email accounts are likely utilised by the hacker news audience. Because we're all well aware of the value of our privacy, the value of our personal data, and the aggressive and often illegal efforts by major tech firms and data brokers to acquire both.

      It's incredibly important to continue progress in the area, both in terms of informing the public (and politicians) of how our behaviour is observed and shaped by social networks and big tech: and by taking all obvious and easily available measures to reduce and remove the information they have and continue to gather.

      One obvious way is by not sharing private sexual data with a major corporation, where not absolutely necessary.

      Edit: Oh, and since a reference to the Luddites is a regular thought terminating cliche on HN - https://www.currentaffairs.org/news/2021/06/the-luddites-wer...

      1 reply →

It's true that a lot is already changing, and the fact that AI is developing is interesting. I recently tried a website for exposing people through AI, here it is- https://ai-deep-nude.com/, and what was surprising was that it worked. I don't know what will happen next.

Yeap, it's started... https://www.johnlennox.org/shop/24/2084-artificial-intellige...

"We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems..."

I dread to think where society is going to be in 10-15 years. We've had a generation or two raised thinking porn == sex and the next generation will all be in romantic relationships with ChatGPT. Businesses have just given up on having any social responsibility whatsoever.