Comment by awb
12 hours ago
> What if I specifically tell it to not do anything nefarious or illegal?
Sure, but a reasonable user would expect that condition to be implicit in using a commercial model.
It’s what the safety/alignment discussion is about: how we can get models to actually comply with laws & ethics.
But the same problem exists in the real world. If you tell someone to “Try everything possible to get it done, I don’t care what it takes”, I’d imagine that people would be far more likely to bend/break rules than if you said “could you please help me with… ?”
Do agents know exactly what jurisdiction I am in and which national, state, and local laws apply to me?
Good point. Not sure the average user would consider this though.
It’s not their responsibility to know, it’s yours.
That might be the ultimate legal guidance, but is it settled though?
> Sure, but a reasonable user would expect that condition to be implicit in using a commercial model.
In fact, adding it might make things worse as it shows at least some awareness of the risks.