← Back to context

Comment by Christine725

14 days ago

Models are of course different from humans, because the process by which they were created is different. But what’s undeniable is that humans also love to quote or repeat what others have said — we learn from our own kind, that’s how we gain experience. Yet rarely does anyone hold a person to a word-for-word standard over the course of their entire life, checking how many of their sentences were picked up from other people’s conversations — and then call that infringement. Just as no one right now would say I’m plagiarizing a model’s speaking style because I use em dashes, and no one would consider it misconduct when I reference a famous person’s ideas in everyday conversation. I don’t think models intend to infringe; it’s simply how they learned language. But perhaps, just like humans, they need to learn to provide more citations for what they reference.

Even individual words can be an issue. Humans understand when you want a new story about a magic school there’s issues using Hogwarts as the name.

LLM’s will happily regurgitate multiple paragraphs practically verbatim if you don’t specifically design them not to behave in this way.

Because ultimately when you design a system to best predict the next output based on a given input perfect replication of prior training is the correct response mathematically.