Comment by leumon
17 hours ago
> We’re continuing to make progress toward a version of ChatGPT designed for adults over 18, grounded in the principle of treating adults like adults, and expanding user choice and freedom within appropriate safeguards. To support this, we’ve rolled out age prediction for users under 18 in most markets. https://help.openai.com/en/articles/12652064-age-prediction-...
interesting
Pornographic use has long been the "break glass in case of emergency" for the LLM labs when it comes to finances.
My personal opinion is that while smut won't hurt anyone in of itself, LLM smut will have weird and generally negative consequences. As it will be crafted specifically for you on top of the intermittent reinforcement component of LLM generation.
For those interested in smut I'd recommend to use local Mistral models.
While this is a valid take, I feel compelled to point out Chuck Tingle.
The sheer amount and variety of smut books (just books) is vastly larger than anyone wants to realize. We passed the mark decades ago where there is smut available for any and every taste. Like, to the point that even LLMs are going to take a long time to put a dent in the smut market. Humans have been making smut for longer than we've had writing.
But again I don't think you're wrong, but the scale of the problem is way distorted.
That’s all simple one way consumption though. I suspect the effect on people is very different when it’s interactive in the way an LLM can be that we’ve never had to recon with before.
That’s where the danger may lie.
7 replies →
I want smut that talks about agent based development and crawdbot to do dirty dirty things.
Does that exist yet. I don't think so.
2 replies →
i've always wondered how much the increasing prevalence of smut & not so niche romance novels, that have proliferated since e-readers became mainstream, have had on Gen Z and younger's sometimes unrealistic view/expectations of relationship. A lot of time is spent on porn sites etc. but not so much on how mainstream some of these novels have become
8 replies →
> The sheer amount and variety of smut books (just books) is vastly larger than anyone wants to realize. We passed the mark decades ago where there is smut available for any and every taste.
It's important to note that the vast majority of such books are written for a female audience, though.
Whatever reward-center path is short-circuiting in 0.0001% of the population and leading to LLM psychosis will become a nuclear bomb for them if we get the sex drive involved too.
I guess technically it will make some onlyfans content creators unemployed, given there is pretty large market for custom sexual content there.
"Legacy Smut" is well known to cause many kinds of harm to many kind of people, from the participants to the consumers.
I can do as much smut as I want through the API for all SOTA models.
true, but:
1. you have to "jailbreak" the model first anyway, which is what's easier to do over API
2. is average layman aware of the concept of "API"? no, unlikely. apps and web portals are more convenient, which is going to lower the bar to access LLM porn
1 reply →
Why llm smut in particular? There's already a vast landscape of the interactive, VR games for all tastes.
Why LLM is supposed to be worse?
I can already see our made to order, LLM generated, VR/neurolink powered, sex fantasies come to life. Throw in the synced Optimus sex robots…
I can see why Elons making the switch from cars. We certainly won’t be driving much
I'm waiting until someone combines LLMs with a humanoid robot and a realdoll. That will have a lot of consequences.
People are already addicted to non-interactive pornography so this is going to be even worse.
How I think it could play out:
- OpenAI botches the job. Article pieces are written about the fact that kids are still able to use it.
- Sam “responds” by making it an option to use worldcoin orbs to authenticate. You buy it at the “register me” page, but you will get an equivalent amount of worldcoin at current rate. Afterwards the orb is like a badge that you can put on your shelf to show to your guests.
“We heard you loud and clear. That’s why we worked hard to provide worldcoin integration, so that users won’t have to verify their age through annoying, insecure and fallible means.” (an example marketing blurb would say, implicitly referring to their current identity servicer Persona which people find annoying).
- After enough orb hardware is out in the public, and after the api gains traction for 3rd parties to use it, send a notice that x months for now, login without the orb will not be possible. “Here is a link to the shop page to get your orb, available in colors silver and black.”
It says what to do if you are over 18, but thinks you are under 18. But what if it identifies someone under 18 as being older?
And what if you are over 18, but don't want to be exposed to that "adult" content?
> Viral challenges that could push risky or harmful behavior
And
> Content that promotes extreme beauty standards, unhealthy dieting, or body shaming
Seem dangerous regardless of age.
> And what if you are over 18, but don't want to be exposed to that "adult" content?
Don't prompt it.
What are these extremes beauty standards being promoted?
Because it seems to me large swaths of the population need some beauty standards
This is for advertising purposes, not porn. They might feign that's the reason, but it's to allow alcohol & pharma to advertise, no doubt.
both, actually. porn for users, ad spots for companies.
Porn and ads, it's the convergent evolution theory for all things on the internet.
My personal take is that there has been no progress - potentially there has been a regression on all LLM things outside of coding a scientific pursuits - I used to have great fun with LLMs with creative writing stuff, but I feel like current models are stiff and not very good prose writers.
This is also true for stuff like writing clear but concise docs, they're overly verbose while often not getting the point across.
Yeah, I’ve had great success at coding recently, but every time I try to get an LLM to write me a spec it generates endless superlatives and a lot of flowery language.
I feel like this comes from the rigorous Reinforcement Learning these models go through now. The token distribution is becoming so narrow, so the models give better answers more often that is stuffles their creativity and ability to break out of the harness. To me, every creative prompt I give them turns into kind of the same mush as output. It is rarely interesting
Sexual and intimate chat with LLMs will be a huge market for whoever corners it. They'd be crazy to leave that money on the table.
That's why laws against drugs are so terrible, it forces law-abiding businesses to leave money on the table. Repeal the laws and I'm sure there will be tons of startups to profit off of drug addiction.
There are many companies making money off alcohol addiction, video game addiction, porn addiction, food addiction, etc. Should we outlaw all these things? Should we regulate them and try to make them safe? If we can do that for them, can't we do it for AI sex chat?
7 replies →
No need: https://en.wikipedia.org/wiki/Opioid_epidemic_in_the_United_...
The majority of illegal drugs aren't addictive, and people are already addicted to the addictive ones. Drug laws are a "social issue" (Moral Majority-influenced), not intended to help people or prevent harm.
The Politician's syllogism in action:
That is terrible.
Se have to do something.
This is something.
We must do it.
It terms of harm current laws on drugs fail everyone but teetotaller who want everyone else to have a miserable life too.
> Repeal the laws and I'm sure there will be tons of startups to profit off of drug addiction.
Worked for gambling.
(Not saying this as a message of support. I think legalizing/normalizing easy app-based gambling was a huge mistake and is going to have an increasingly disastrous social impact).
1 reply →
what about laws against porn? Oh, wait, no, that's a legitimate business.
Respectfully, this is a piss take.
US prohibition on alcohol and to the large extent performative "war on drugs" showed what criminalization does (empowers, finances and radicalises the criminals).
Portugal's decriminalisation, partial legalisation of weed in the Netherlands, legalisation in some American states and Canada prove legal businesses will better and safer provide the same services to the society, and the lesser societal and health cost.
And then there's the opioid addiction scandal in the US. Don't tell me it's the result of legalisation.
Legalisation of some classes of the drugs (like LSD, mushrooms, etc) would do much more good than bad.
Conversely, unrestricted LLMs are avaliable to everyone already. And prompting SOTA models to generate the most hardcore smut you can imagine is also possible today.
2 replies →
It's not just chat. Remember image and video generation are on the table. There are already a huge category of adult video 'games' of this nature. I think they use combos of pre-rendered and dynamic content. But really not hard to imagine a near future that interactive and completely personalized AI porn in full 4kHDR or VR is constantly and near-instantly available. I have no idea the broader social implications of all that, but the tech itself feels inevitable and nearly here.
If your goal is to make money, sure. If your goal is to make AI safe, not so much.
The definition of safety is something that we cannot agree on.
For me, letting people mindlessly vibecode apps and then pretend this code can serve purpose for others - this is what's truly unsafe.
Pornographic text in LLM? Come on.
1 reply →
It will be an even bigger market when robotics are sufficiently advanced.
At some point there will be robots with LLMs and actual real biological skin with blood vessels and some fat over a humanoid robot shell. At that point we won’t need real human relationships anymore.
Will be?
I've seen four startups make bank on precicely that.
My main concern is when they'll start to allow 18+ deepfakes
That market is for local models right now.
What’s the goal there? Sexting?
I’m guessing age is needed to serve certain ads and the like, but what’s the value for customers?
Even when you're making PG content, the general propriety limits of AI can hinder creative work.
The "Easter Bunny" has always seemed creepy to me, so I started writing a silly song in which the bunny is suspected of eating children. I had too many verses written down and wanted to condense the lyrics, but found LLMs telling me "I cannot help promote violence towards children." Production LLM services would not help me revise this literal parody.
Another day I was writing a romantic poem. It was abstract and colorful, far from a filthy limerick. But when I asked LLMs for help encoding a particular idea sequence into a verse, the models refused (except for grok, which didn't give very good writing advice anyway.)
Just today I asked how to shut down a Mac with "maximal violence". I was looking for the equivalent of "systemctl shutdown -f -f" and it refused to help me do violence.
Believe me, the Mac deserved it.
2 replies →
If you don't think the potential market for AI sexbots is enormous you have not paid attention to humanity.
This is not a potential market, this market is already thriving (and whoever wants to uses ChatGPT or Claude for that anyway).
ClosedAI just wants to a piece of the casual user too.
There is a subreddit called /r/myboyfriendisAI, you can look through it and see for yourself.
according to the age-prediction page, the changes are:
> If [..] you are under 18, ChatGPT turns on extra safety settings. [...] Some topics are handled more carefully to help reduce sensitive content, such as:
- Graphic violence or gore
- Viral challenges that could push risky or harmful behavior
- Sexual, romantic, or violent role play
- Content that promotes extreme beauty standards, unhealthy dieting, or body shaming
Porn has driven just about every bit of progress on the internet, I don't see why AI would be the exception to that rule.
yeah linus was beating it constantly to porn while developing the linux kernal. its proven fact. every oss project that runs the internet was done the same way, sure.
2 replies →
This seems like a believable lie, until you think about it for 2 seconds.
No. Porn has not driven even a fraction of the progress on the progress on the internet. Not even close to one.
13 replies →
West World style robots
There is a huge book market for sexual stories, in case you were not aware.
eh there's an old saying that goes "no Internet technology can be considered a success until it has been adopted by (or in this case integrated with) the porn industry".
I am 30 years old, literally told chatgpt I was a software developer, all my queries are something an adult would ask, yet OpenAI assumed I was under 18 and asked me for a persona age verification, which of course I refused because Persona is shady as a company (plus I'm not giving my personal ID to some random tech company).
ChatGPT is absolute garbage.
imagine if every only fans creator suddenly paid a portion of their revenue to OpenAI for better messaging with their followers…
Instead of paying it to the human third party firms that currently handle communication with subscribers?