Comment by sa-code

2 years ago

I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing.

Is it fair to assume that I won't get refusals for code generation and RAG on documentation?

6 comments

sa-code

Reply
scarmig  2 years ago

> I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing.

At least circa 8 months ago on ChatGPT (an aeon ago, I recognize), I could readily get it to make gendered jokes about men but would get a refusal when asking for gendered jokes about women. I think things have "improved" in that time, meaning a more equal distribution of verboten topics, but my preference would be a tool that does what I want it to, not one that tries to protect me from myself for society's or my own good. (There's a related problem in the biases introduced by the training process.)

> Is it fair to assume that I won't get refusals for code generation and RAG on documentation?

Give it a couple years. "Can you write me a Java function that, given an array length, a start of a range, and the end of a range, returns whether the range is valid or not?" "I'm sorry, but this code is inappropriate to share. Shall I purchase a license from Oracle for access to it for you?"

  • sa-code  2 years ago

    Oh for sure. We're in the golden age of LLMs before the enshittification commences and we don't appreciate that enough

    • scarmig  2 years ago

      And, of course, we'll have ads incorporated (some subtle, some not) into every response. Native advertising!

e-max  2 years ago

No, Claude really DO refuse to do most benign shit. For example - I am preparing for driving exams in German, a language I am not fluent in. So I asked Claude to help me with questions the examiner might ask on the exam (what should be tire pressure and so on). GPT-4 worked perfectly! Claude had an absolute meltdown because "I don't feel comfortable pretending to be a driving examiner because I am not really an examiner, I am Claude, created by Anthropic to be helpful, harmless and HONEST". You are probably safe with code generation, but any step left or right and you get "I am Claude"

taf2  2 years ago

since they don't have a share feature like some other open/er AI's it's difficult to compare. My favorite one to share as I recall was when Anthropic first released their chat UI. I asked it whether they had an API to which it told me know. After I shared the documentation for it's API to it it went into a forever denial of everything I asked it. I wish I still had the full dialog it was very funny.