Comment by sockaddr
3 years ago
Now I can’t help but imagine the raw GPT-4 is just some huge raging asshole and it just has a bunch of “handlers”.
3 years ago
Now I can’t help but imagine the raw GPT-4 is just some huge raging asshole and it just has a bunch of “handlers”.
> the raw GPT-4 is just some huge raging asshole
That's pretty much exactly how one of the OpenAI Red Teamers Nathan Labenz describes the raw GPT-4, starting around 45 minutes into the video:
https://news.ycombinator.com/item?id=35377741
> huge raging asshole
That's not really how he described it.
His point is that the raw model that became GPT-4 would do literally anything it asked you to.
It would write fascist propaganda just as readily as it would offer medical advice. Literally any and all input from the user was fair game.
But it wouldn't just veer from medical advice into fascist propaganda, not unless the user was steering it in that direction.
> His point is that the raw model that became GPT-4 would do literally anything it asked you to.
It's unfortunate that people would abuse that and we can't have the raw model just for personal use. The story telling and characters alone would be worth it. The safety guards tend to seep into fictional scenarios, making them more bland and preachy.
1 reply →
[dead]
I have been writing prompts for a GPT-based document 'digester' for business-internal people who can't code but do have the right background knowledge. Every day I have to expand the prompt because I found a new spot where I have to hold the thing's hands so it does the right thing :)