Comment by Terr_

IMO we must take it a step further: In this context "the LLM" we're all thinking of can never be taught to feel shame because it doesn't exist, it's a fictional character we humans "see" inside a story being conveyed to us. (The real LLM is an algorithm constantly taking a document and making it slightly longer based on what seems normal for all documents.)

So "the LLM can't feel shame" is true... on the same level that "Dracula thirsts for blood". All we can do is change the story-generator so that the next story has characters that fit better in our imagination.