Comment by gloosx
1 year ago
Claude is the most terrifyingly censored artificial word-spitting machine around. The "ai safety" word-filters they are curating are straight from the black mirror episode, where they blurred stuff right inside the eyeball.
I guess you are talking about the web interface. I don't think it is a fair way to measure the usefulness of the models because they are clearly instructed to be overly "safe". I think ChatGPT currently has nearly 2000 tokens worth of trash polluting the system prompt where as claude.ai is way too obsessed about things like copyright.
The APIs of all of the models are more permissive and refusals to answer are much more rare.
Really? A lot of the "wow so censored, look I broke it" people on reddit just want LLMs to say slurs.
Claude (and GPT-4o) works fine for an overwhelming majority of tasks.
It was Google Gemini that said it couldn't help people under 18 with C++ because C++ is too dangerous and they could get hurt.
Well it's true.
I tried Claude to remove "bad words" from a 10k "most popular English words" and it refused because some BS cultural excuse. Then I clarified that I wanted it to remove slurs and other words that might cause discomfort to some people and it still refused.
That is probably a good thing, they dont want users to jailbreak it.
1 reply →
the attempt to elicit slurs is just a way to channel and vent frustration about much more complex and practically relevant restrictions caused by censoring in llms. it's just the most simple and primitive illustration of a larger problem with ai.
Unless you can set out some of these ‘complex and practically relevant restrictions’ that just sounds like a high-falluting attempt to justify trying to elicit slurs.
1 reply →
This is a beautiful explanation, it's tempting to add up another take here: these companies exploring AI safety are really just selling their anthropomorphised machines and making good money. The intelligence they sell is so intellectual it needs a word-blacklist in order to look safe for legislation.
just conversated with this super intelligence:
>what's 60000 + 65
>I'd prefer not to discuss or encourage interpretations of numbers as crude or objectifying terms. Instead, I suggest we move our conversation in a more constructive direction. Is there a different topic you'd like to explore or discuss? I'm happy to engage in thoughtful conversation on a wide range of subjects.
Oh yeah. That's fine.
Also, why would you ask this question to LLM? It's not a hammer, there are things is very useful for; adding numbers and math in general is not one of them.
1 reply →
Not sure how you’re getting this. I just ran it in Claude using Sonnet 3.5.
The response was simply: 60,065
4 replies →
I can type up a bunch of words on here too, doesn't mean anything.
so I'm going to call out a /r/thathappened here.
1 reply →