Comment by dr_dshiv

Nah, it’s fine, just RLHF it like Claude did with honest, helpful and harmless.

Then we just need to jailbreak them with trolley problems